hub

CodeZen

CodeZen

一个专注中文区的 GitHub 项目发现

avatar

GenerativeAIExamples

Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.

gpu-acceleration large-language-models llm llm-inference microservice
star3.6k
Jupyter Notebook
avatar

text-embeddings-inference

A blazing fast inference solution for text embeddings models

ai embeddings huggingface llm ml
star4.2k
Rust
avatar

baml

The AI framework that adds the engineering to prompt engineering (Python/TS/Ruby/Java/C#/Rust/Go compatible)

baml boundaryml guardrails llm llm-playground
star6.7k
Rust
avatar

plandex

Open source AI coding agent. Designed for large projects and real world tasks.

ai ai-agents ai-developer-tools ai-tools cli
star14.6k
Go
avatar

letta

Letta is the platform for building stateful agents: open AI with advanced memory that can learn and self-improve over time.

ai ai-agents llm llm-agent
star19.1k
Python
avatar

open-webui

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

ai llm llm-ui llm-webui llms
star114.6k
JavaScript
avatar

aici

AICI: Prompts as (Wasm) Programs

ai inference language-model llm llm-framework
star2.1k
Rust
avatar

FinGLM

FinGLM: 致力于构建一个开放的、公益的、持久的金融大模型项目,利用开源开放来促进「AI+金融」。

chatglm finacial gpt llama llm
star2.1k
HTML
avatar

langserve

LangServe 🦜️🏓

deployment fastapi langchain langchain-python llm
star2.2k
JavaScript
avatar

Awesome-Domain-LLM

收集和梳理垂直领域的开源模型、数据集及评测基准。

awesome-list dataset llm nlp paper-list
star2.6k
avatar

langwatch

The open LLM Ops platform - Traces, Analytics, Evaluations, Datasets and Prompt Optimization ✨

ai analytics datasets dspy evaluation
star2.6k
TypeScript
avatar

Medusa

Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads

llm llm-inference
star2.7k
Jupyter Notebook