MindSpore的vLLM插件,支持基于vLLM框架部署MindSpore模型的推理服务。
MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.
AKG(Auto Kernel Generator) is an optimizer for operators in Deep Learning Networks, which provides the ability to automatically fuse ops with specific patterns.
MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.
cann-ops-adv,是基于昇腾硬件的融合算子库(adv表示advanced)。