OpenLLM

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

onyx

Open Source AI Platform - AI Chat with advanced features that works with every LLM

web-llm

High-performance In-browser LLM Inference Engine

DB-GPT

AI Native Data App Development framework with AWEL(Agentic Workflow Expression Language) and Agents

mlc-llm

Universal LLM Deployment Engine with ML Compilation

llm-cookbook

面向开发者的 LLM 入门教程，吴恩达大模型系列课程中文版

pandas-ai

Chat with your database or your datalake (SQL, CSV, parquet). PandasAI makes data analysis conversational using LLMs and RAG.

dify

Production-ready platform for agentic workflow development.

Huatuo-Llama-Med-Chinese

Repo for BenTsao [original name: HuaTuo (华驼)], Instruction-tuning Large Language Models with Chinese Medical Knowledge. 本草（原名：华驼）模型仓库，基于中文医学知识的大语言模型指令微调

marvin

an ambient intelligence library

llm

[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models

GPTCache

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.