@propathee
shaoshengqi 暂无简介
MindSpore的vLLM插件,支持基于vLLM框架部署MindSpore模型的推理服务。
MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.
MindSpore document
AKG(Auto Kernel Generator) is an optimizer for operators in Deep Learning Networks, which provides the ability to automatically fuse ops with specific patterns.