Python
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
997Curated repositories
46,238.6kTotal GitHub stars
Open sourceBuilt by the community
inference repositories
Hand-picked tools to improve your workflow.
Python · Trending
SGLang is a high-performance serving framework for large language models and multimodal models.
Go · Trending
llm-d Router: The intelligent entry point for inference requests