llama-cpp-rs
Rust bindings for llama.cpp. Minimal, close to raw bindings, kept up to date with upstream.
Quick start
git clone --recursive https://github.com/intentee/llama-cpp-bindings
cd llama-cpp-rs
cargo build --releaseAdd --features cuda for GPU acceleration.
Crates
| Crate | Description |
|---|---|
llama-cpp-bindings |
Safe Rust API |
llama-cpp-bindings-sys |
Raw FFI bindings |
llama-cpp-bindings-build |
Build system |