MindIE1.0.0在Atlas 800T A2上推理Qwen2-vl，使用兼容openai接口报错

一、问题现象（附报错日志上下文）：
[2025-05-06 15:03:41.564140+08:00] [15963] [21322] [server] [INFO] [EndPoint http_server.cpp:47] receive request from 192.168.0.37:47686 ,method:GET, uri:/v1/models
[2025-05-06 15:03:41.564200+08:00] [15963] [21322] [server] [INFO] [EndPoint http_server.cpp:56] Http receive response from 192.168.0.58:1028 ,status code 200, body len 108
[2025-05-06 15:04:24.104185+08:00] [15963] [21325] [server] [INFO] [EndPoint http_server.cpp:47] receive request from 192.168.0.37:47710 ,method:GET, uri:/v1/models
[2025-05-06 15:04:24.104246+08:00] [15963] [21325] [server] [INFO] [EndPoint http_server.cpp:56] Http receive response from 192.168.0.58:1028 ,status code 200, body len 108
[2025-05-06 15:04:27.320411+08:00] [17231] [15965] [server] [ERROR] [infer_tokenizer.cpp:124] : [InferTokenizer::DownloadUrl] Download fail: N8pybind1117error_already_setE, TypeError: expected str, bytes or os.PathLike object, not dict

At:
  /root/miniconda3/envs/mindie/lib/python3.10/posixpath.py(118): splitext
  /root/miniconda3/envs/mindie/lib/python3.10/site-packages/mies_tokenizer/tokenizer.py(339): _download
  /root/miniconda3/envs/mindie/lib/python3.10/site-packages/mies_tokenizer/tokenizer.py(189): download_url

[2025-05-06 15:04:27.320479+08:00] [17231] [15965] [server] [ERROR] [infer_tokenizer.cpp:915] : Process encode or decode failed.
[2025-05-06 15:04:27.174538+08:00] [15963] [21327] [server] [INFO] [EndPoint http_server.cpp:47] receive request from 192.168.0.37:47712 ,method:POST, uri:/v1/chat/completions
[2025-05-06 15:04:27.320676+08:00] [15963] [21327] [server] [ERROR] [EndPoint vllm_openai_infer.cpp:993] [InferTokenizer::DownloadUrl] Download fail: TypeError: expected str, bytes or os.PathLike object, not dict for id=endpoint_common_297
[2025-05-06 15:04:27.320760+08:00] [15963] [21327] [server] [ERROR] [common_infer.cpp:141] : [MIE04E020204] [endpoint] Check input Text failed for id=endpoint_common_297
[2025-05-06 15:04:27.320857+08:00] [15963] [21327] [server] [INFO] [EndPoint http_server.cpp:56] Http receive response from 192.168.0.58:1028 ,status code 422, body len 157

二、软件版本:
-- MindIE版本： 1.0.0
-- CANN 版本 8.0.0商用版:  
--Tensorflow/Pytorch/MindSpore 版本:Pytorch 2.1.0
--Python 版本 (e.g., Python 3.7.5): Python 3.10.16
-- MindStudio版本 (e.g., MindStudio 2.0.0 (beta3)): 不清楚
--操作系统版本 (e.g., Ubuntu 18.04): Ubuntu 22.04.5 LTS

三、测试步骤：
mindie推理Qwen2-vl-7B模型
1.正常启动服务化 ./bin/mindieservice_daemon
2.服务化正常启动
3.在openwebui工具中添加openai格式接口地址
4.调用openwebui上传图片要求分析。
5.报错 422，无法下载图片

四、日志信息:
xxxx
请根据自己的运行环境参考以下方式搜集日志信息，如果涉及到算子开发相关的问题，建议也提供UT/ST测试和单算子集成测试相关的日志。

日志提供方式:
将日志打包后作为附件上传。若日志大小超出附件限制，则可上传至外部网盘后提供链接。

Ascend/ModelZoo-PyTorch

内容风险标识

评论 (0)

Ascend/ModelZoo-PyTorch .gitee-modal { width: 500px !important; }

内容风险标识