Expert Kit is an efficient foundation of Expert Parallelism (EP) MoE model Inference on heterogenous hardware.
最近更新: 10个月前vLLM is a fast and easy-to-use library for LLM inference and serving.
最近更新: 11个月前release management including key features, release plan, development and branch plan, release scope and notes
最近更新: 11个月前QA repo provides rules about how QA team runs and how contributors to this project, also includes test cases and framework
最近更新: 12个月前Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
最近更新: 1年前MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.
最近更新: 接近3年前StratoVirt is an opensource VMM(Virtual Machine Manager) which aims to perform next generation virtualization.StratoVirt is based on Rust programming language.StratoVirt is lightweight, efficient and safe.It also has features like Full Sence Support and Modules Flexible Splitting.
最近更新: 3年多前