ais_bench动态shape模型推理报错

使用atc转换onnx模型，模型输入shape不固定
使用命令为
atc --framework=5 --model=./PaddleOCR/inference/det_onnx/model.onnx --output=./ch_PP-OCRv3_det_bs1_dynamic_shape --input_shape="x:1,3,-1,-1" --soc_version=Ascend310P3

模型转换成功，使用ais_bench进行模型推理时报错：
python3 -m ais_bench --model=ch_PP-OCRv3_det_bs1_dynamic_shape_linux_aarch64.om --input=./prep_data_dir/img_npy --output=./ --output_dirname=results_bs1 --auto_set_dymdims_mode=1 --outfmt=NPY
[INFO] acl init success
[INFO] open device 0 success
[INFO] load model ch_PP-OCRv3_det_bs1_dynamic_shape_linux_aarch64.om success
[INFO] create model description success
[INFO] try get model batchsize:1
[INFO] output path:./results_bs1
[INFO] get filesperbatch files0 size:10457088 tensor0size:0 filesperbatch:1 runcount:19
the dynamic_dims parameter is not specified for model conversionTraceback (most recent call last):
  File "/usr/local/python3.10.8/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/local/python3.10.8/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/usr/local/python3.10.8/lib/python3.10/site-packages/ais_bench/__main__.py", line 18, in <module>
    exec(open(os.path.join(cur_path, "infer/__main__.py")).read())
  File "<string>", line 278, in <module>
  File "/usr/local/python3.10.8/lib/python3.10/site-packages/ais_bench/infer/infer_process.py", line 762, in infer_process
    main(args)
  File "/usr/local/python3.10.8/lib/python3.10/site-packages/ais_bench/infer/infer_process.py", line 490, in main
    warmup(session, args, intensors_desc, infileslist[0])
  File "/usr/local/python3.10.8/lib/python3.10/site-packages/ais_bench/infer/infer_process.py", line 166, in warmup
    outputs = run_inference(session, args, infeeds, out_array=True)
  File "/usr/local/python3.10.8/lib/python3.10/site-packages/ais_bench/infer/infer_process.py", line 181, in run_inference
    set_dymdims_shape(session, inputs)
  File "/usr/local/python3.10.8/lib/python3.10/site-packages/ais_bench/infer/infer_process.py", line 147, in set_dymdims_shape
    session.set_dynamic_dims(dydims)
  File "/usr/local/python3.10.8/lib/python3.10/site-packages/ais_bench/infer/interface.py", line 127, in set_dynamic_dims
    self.session.set_dynamic_dims(dym_dims)
RuntimeError: [-1][ACL: general failure] 
[INFO] unload model success, model Id is 2147483648
[INFO] end to reset device 0
[INFO] end to finalize acl

在CANN提交工单给atc团队，以上模型转换命令是团队回复提供的，并且提交了报错日志，确认是在推理流程时出现的问题，模型转换没有问题，请查看哪里出现的问题？

Ascend/tools
暂停

内容风险标识

评论 (0)

Ascend/tools暂停 .gitee-modal { width: 500px !important; }

内容风险标识