Watch omniai/omni-npu

A vLLM (0.12.0) out-of-tree platform plugin that enables running vLLM on NPU (Ascend/torch_npu).

Watch omniai/omni-eplb

Watch omniai/omni-proxy

Watch eliazhang/omni_infer_2 forked from omniai/omni_infer

Omni_Infer is a suite of inference accelerators designed for the Ascend NPU platform, offering native support and an expanding feature set.

Watch eliazhang/omni_infer_1 forked from omniai/omni_infer

Omni_Infer is a suite of inference accelerators designed for the Ascend NPU platform, offering native support and an expanding feature set.

Watch 林清扬/omni_infer forked from omniai/omni_infer

Omni_Infer is a suite of inference accelerators designed for the Ascend NPU platform, offering native support and an expanding feature set.