chaunceyjiang - Overview
Karmada/OpenELB/HAMi/vLLM approver cilium/istio member
This project is designed to simulate GPU information, making it easier to test scenarios where a GPU is not available.
C++ 65 3
A high-throughput and memory-efficient inference and serving engine for LLMs
Python 75.3k 15.2k
Open, Multi-Cloud, Multi-Cluster Kubernetes Orchestration
Go 5.4k 1.1k
eBPF-based Networking, Security, and Observability
Go 24k 3.7k
Heterogeneous GPU Sharing on Kubernetes
Go 3.2k 501
Load Balancer Implementation for Kubernetes in Bare-Metal, Edge, and Virtualization
Go 1.8k 211