mlc-ai

Pinned Loading

Universal LLM Deployment Engine with ML Compilation

Python 22.3k 2k
High-performance In-browser LLM Inference Engine

TypeScript 17.7k 1.2k
Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.

TypeScript 991 206
Fast, Flexible and Portable Structured Generation

C++ 1.6k 135

Showing 10 of 34 repositories

mlc-ai/wheels’s past year of commit activity

HTML
1
0
0 0
Updated Mar 31, 2026
xgrammar Public
Fast, Flexible and Portable Structured Generation

mlc-ai/xgrammar’s past year of commit activity
mlc-ai/relax’s past year of commit activity

Python
175
Apache-2.0
96 21 5
Updated Mar 30, 2026
Pith-Train Public
Efficient, Python-native, end-to-end MoE training in ~10K lines of code.

mlc-ai/Pith-Train’s past year of commit activity

Python
23
Apache-2.0
4 0 2
Updated Mar 30, 2026
mlc-llm Public
Universal LLM Deployment Engine with ML Compilation

mlc-ai/mlc-llm’s past year of commit activity
web-llm Public
High-performance In-browser LLM Inference Engine

mlc-ai/web-llm’s past year of commit activity
mlc-ai/package’s past year of commit activity

Shell
15
Apache-2.0
16 3 0
Updated Mar 27, 2026
mlc-ai/XGrammar-web-assets’s past year of commit activity

1
Apache-2.0 0
0 0
Updated Mar 23, 2026
tokenizers-cpp Public
Universal cross-platform tokenizers binding to HF and sentencepiece

mlc-ai/tokenizers-cpp’s past year of commit activity

C++
471
Apache-2.0
116 25 3
Updated Feb 20, 2026
web-llm-chat Public
Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.

mlc-ai/web-llm-chat’s past year of commit activity

TypeScript
991
Apache-2.0
206 19 14
Updated Feb 18, 2026