opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

airllm

AirLLM 70B inference with single 4GB GPU

lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

TypeChat

TypeChat is a library that makes it easy to build natural language interfaces using types.

inference

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

langchain4j

LangChain4j is an open-source Java library that simplifies the integration of LLMs into Java applications through a unified API, providing access to popular LLMs and vector databases. It makes implementing RAG, tool calling (including support for MCP), and agents easy. LangChain4j integrates seamlessly with various enterprise Java frameworks.

promptflow

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

ChatGLM2-6B

ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型

CopilotKit

React UI + elegant infrastructure for AI Copilots, AI chatbots, and in-app AI agents. The Agentic last-mile 🪁

mem0

Universal memory layer for AI Agents; Announcing OpenMemory MCP - local and secure memory management.

anything-llm

The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.

MetaGPT

🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming