FastGPT

FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing, RAG retrieval, and visual AI workflow orchestration, letting you easily develop and deploy complex question-answering systems without the need for extensive setup or configuration.

semantic-kernel

Integrate cutting-edge LLM technology quickly and easily into your apps

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

griptape

Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.

helicone

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

guardrails

Adding guardrails to large language models.

shell_gpt

A command-line productivity tool powered by AI large language models like GPT-4, will help you accomplish your tasks faster and more efficiently.

llm-workflow-engine

Power CLI and Workflow manager for LLMs (core package)

adrenaline

Chat with (and visualize) your codebase

LMOps

General technology for enabling AI capabilities w/ LLMs and MLLMs

sdnext

SD.Next: All-in-one WebUI for AI generative image and video creation

AstrBot

✨ 一站式 LLM 聊天机器人平台及开发框架 ✨ 支持 QQ、QQ频道、Telegram、企微、飞书、钉钉 | 知识库、MCP 服务器、OpenAI、DeepSeek、Gemini、硅基流动、月之暗面、Ollama、OneAPI、Dify