Popular repositories Loading

1. llmrouter is a lightweight Python SDK that acts as a layer-4 proxy for routing requests to LLM (Large Language Model) APIs with built-in rate limiting and flexible forwarding. Designed for develope…

   Python 1 1

2. Forked from QuantumNous/new-api

   AI模型接口管理与分发系统，支持将多种大模型转为OpenAI格式调用、支持Midjourney Proxy、Suno、Rerank，兼容易支付协议，可供个人或者企业内部管理与分发渠道使用，本项目基于One API二次开发。🍥 The next-generation LLM gateway and AI asset management system supports multiple lan…

   Go

3. Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python 1

5. Forked from kvcache-ai/Mooncake

   Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

   C++