news

Oct 04, 2024 Preprint update of Preble: Efficient Distributed Prompt Scheduling for LLM Serving comparison with latest SGLang
May 01, 2024 🎉 InferCept was accepted to ICML 2024!