CodeZen - 中文项目发现

CodeZen

一个专注中文区的 GitHub 项目发现

全球开发者

中文开发者

本周热门

本月热门

所有语言

C++

CSS

Dart

HTML

Java

JavaScript

Jupyter Notebook

Kotlin

Lua

PHP

PowerShell

Python

Ruby

Rust

Shell

Swift

TypeScript

Vue

所有主题

react

llm

linux

docker

vue

kubernetes

macos

windows

最新

最旧

最热

最冷

cactus

Kernels & AI inference engine for phones

ai android edge framework ios

star3.6k

C++

Mooncake

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

disaggregation inference kvcache llm rdma

star4.2k

C++

distributed-llama

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

distributed-computing distributed-llm llama2 llama3 llm

star2.7k

C++

PowerInfer

High-speed Large Language Model Serving for Local Deployment

large-language-models llama llm llm-inference local-inference

star8.4k

C++

MNN

MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba. Full multimodal LLM Android App:[MNN-LLM-Android](./apps/Android/MnnLlmChat/README.md). MNN TaoAvatar Android - Local 3D Avatar Intelligence: apps/Android/Mnn3dAvatar/README.md

arm convolution deep-learning embedded-devices llm

star13.4k

C++