infinity

Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali

hallucination-leaderboard

Leaderboard Comparing LLM Performance at Producing Hallucinations when Summarizing Short Documents

lorax

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

GenerativeAIExamples

Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.

text-embeddings-inference

A blazing fast inference solution for text embeddings models

baml

The AI framework that adds the engineering to prompt engineering (Python/TS/Ruby/Java/C#/Rust/Go compatible)

plandex

Open source AI coding agent. Designed for large projects and real world tasks.

letta

Letta is the platform for building stateful agents: open AI with advanced memory that can learn and self-improve over time.

open-webui

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

aici

AICI: Prompts as (Wasm) Programs

FinGLM

FinGLM: 致力于构建一个开放的、公益的、持久的金融大模型项目，利用开源开放来促进「AI+金融」。

langserve

LangServe 🦜️🏓