登录
注册
开源
企业版
高校版
搜索
帮助中心
使用条款
关于我们
开源
企业版
高校版
私有云
模力方舟
AI 队友
登录
注册
Gitee 年度开源项目评选中~
代码拉取完成，页面将自动刷新
仓库状态说明
开源项目
>
人工智能
>
机器学习/深度学习
&&
捐赠
捐赠前请先登录
取消
前往登录
扫描微信二维码支付
取消
支付完成
支付提示
将跳转至支付宝完成支付
确定
取消
Watch
不关注
关注所有动态
仅关注版本发行动态
关注但不提醒动态
89
Star
657
Fork
1.5K
Ascend
/
pytorch
暂停
代码
Issues
41
Pull Requests
350
Wiki
统计
流水线
服务
质量分析
Jenkins for Gitee
腾讯云托管
腾讯云 Serverless
悬镜安全
阿里云 SAE
Codeblitz
SBOM
我知道了，不再自动展开
更新失败，请稍后重试！
移除标识
内容风险标识
本任务被
标识为内容中包含有代码安全 Bug 、隐私泄露等敏感信息，仓库外成员不可访问
torch_npu 初始化 vnpu 设备报错 RuntimeError: Initialize:build/CMakeFiles/torch_npu.dir/compiler_depend.ts:227 NPU error, error code is 107020
DONE
#IAGREM
Bug-Report
warpmatrix
创建于
2024-07-31 10:19
# 问题现象（附报错日志上下文） torch_npu 在虚拟化的 901B 设备上初始化报错，在正常的 910B 设备上初始化没有出现问题。该虚拟化设备可以正常运行 [ACLHelloWorld 示例代码](https://gitee.com/ascend/samples/tree/master/inference/ACLHelloWorld)。 - 虚拟化的参考文档：[虚拟化实例](https://www.hiascend.com/document/detail/zh/computepoweralloca/300/cpaug/cpaug/cpaug_00001.html) 运行代码： ```py # mini-demo.py import torch import torch_npu print(torch.npu.is_available()) print(torch.npu.device_count()) a = torch.randn(2,3).npu() print(a) ``` 报错信息： ```sh $ python mini-demo.py True 1 Traceback (most recent call last): File "/root/mini-demo.py", line 4, in <module> a = torch.randn(2,3).npu() File "/home/ems/miniconda3/lib/python3.10/site-packages/torch/utils/backend_registration.py", line 153, in wrap_tensor_to device_idx = _normalization_device(custom_backend_name, device) File "/home/ems/miniconda3/lib/python3.10/site-packages/torch/utils/backend_registration.py", line 109, in _normalization_device return _get_current_device_index() File "/home/ems/miniconda3/lib/python3.10/site-packages/torch/utils/backend_registration.py", line 103, in _get_current_device_index return getattr(getattr(torch, custom_backend_name), _get_device_index)() File "/home/ems/miniconda3/lib/python3.10/site-packages/torch_npu/npu/utils.py", line 59, in current_device torch_npu.npu._lazy_init() File "/home/ems/miniconda3/lib/python3.10/site-packages/torch_npu/npu/__init__.py", line 214, in _lazy_init torch_npu._C._npu_init() RuntimeError: Initialize:build/CMakeFiles/torch_npu.dir/compiler_depend.ts:227 NPU error, error code is 107020. E39999: Inner Error! E39999: 2024-07-31-09:34:15.289.596 The error from device(chipId:7, dieId:0), serial number is 27, an exception occurred during AICPU execution, stream_id:0, task_id:3, errcode:135175, msg:aicpu execute failed..[FUNC:ProcessStarsAicpuErrorInfo][FILE:device_error_proc.cc][LINE:1269] TraceBack (most recent call last): Task execute failed, device_id=0, stream_id=0, task_id=3, flip_num=0, task_type=86.[FUNC:GetError][FILE:stream.cc][LINE:1082] Failed to synchronize TaskTimeoutSetTask, retCode=0x7150059.[FUNC:SetTimeoutConfig][FILE:runtime.cc][LINE:4977] rtSetOpExecuteTimeOut execute failed, reason=[task timeout][FUNC:FuncErrorReason][FILE:error_message_manage.cc][LINE:53] set op execute timeout failed, runtime result = 107020[FUNC:ReportCallError][FILE:log_inner.cpp][LINE:161] [ERROR] 2024-07-31-09:34:15 (PID:12328, Device:0, RankID:-1) ERR99999 UNKNOWN application exception ``` ## 软件版本: - CANN 版本 8.0.T15: ```bash $ cat ascend_toolkit_install.info package_name=Ascend-cann-toolkit version=8.0.T15 innerversion=V100R001C18B604 compatible_version=[V100R001C15,V100R001C18],[V100R001C30],[V100R001C13],[V100R003C11],[V100R001C29],[V100R001C10] arch=aarch64 os=linux path=/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux ``` - Pytorch版本：2.1.0 - Python 版本：Python 3.10.14 - 操作系统版本：Huawei Cloud EulerOS 2.0.2303.1 ## 日志信息 其他补充信息： - `npu-smi info`:  - `log/debug/plog/plog-12328_20240731093415374.log` <details> ```txt [ERROR] RUNTIME(12328,python):2024-07-31-09:34:15.288.219 [stars_engine.cc:1312]12328 ProcLogicCqReport:[INIT][DEFAULT]Task run failed, device_id=0, stream_id=0, task_id=3, sqe_type=1(aicpu), errType=0x4(task timeout), sqSwStatus=0 [ERROR] RUNTIME(12328,python):2024-07-31-09:34:15.289.562 [device_error_proc.cc:1269]12328 ProcessStarsAicpuErrorInfo:[INIT][DEFAULT]report error module_type=0, module_name=E39999 [ERROR] RUNTIME(12328,python):2024-07-31-09:34:15.289.573 [device_error_proc.cc:1269]12328 ProcessStarsAicpuErrorInfo:[INIT][DEFAULT]The error from device(chipId:7, dieId:0), serial number is 27, an exception occurred during AICPU execution, stream_id:0, task_id:3, errcode:135175, msg:aicpu execute failed.. [ERROR] RUNTIME(12328,python):2024-07-31-09:34:15.289.743 [task_info.cc:313]12328 DoCompleteSuccess:[INIT][DEFAULT]device_id=0, retCode=0x105, [task timeout]. [ERROR] RUNTIME(12328,python):2024-07-31-09:34:15.289.756 [task_info.cc:286]12328 PrintErrorInfoCommon:[INIT][DEFAULT]Task execute failed, device_id=0, stream_id=0, task_id=3, flip_num=0, task_type=86. [ERROR] RUNTIME(12328,python):2024-07-31-09:34:15.289.842 [stream.cc:1079]12328 GetError:[INIT][DEFAULT]Stream Synchronize failed, stream_id=0, retCode=0x105, [task timeout]. [ERROR] RUNTIME(12328,python):2024-07-31-09:34:15.289.850 [stream.cc:1082]12328 GetError:[INIT][DEFAULT]report error module_type=7, module_name=EE9999 [ERROR] RUNTIME(12328,python):2024-07-31-09:34:15.289.856 [stream.cc:1082]12328 GetError:[INIT][DEFAULT]Task execute failed, device_id=0, stream_id=0, task_id=3, flip_num=0, task_type=86. [ERROR] RUNTIME(12328,python):2024-07-31-09:34:15.289.894 [runtime.cc:4977]12328 SetTimeoutConfig:[INIT][DEFAULT]report error module_type=0, module_name=EE9999 [ERROR] RUNTIME(12328,python):2024-07-31-09:34:15.289.900 [runtime.cc:4977]12328 SetTimeoutConfig:[INIT][DEFAULT]Failed to synchronize TaskTimeoutSetTask, retCode=0x7150059. [ERROR] RUNTIME(12328,python):2024-07-31-09:34:15.289.935 [logger.cc:1499]12328 SetOpExecuteTimeOut:[INIT][DEFAULT]Set op execute timeout failed, timeout=547. [ERROR] RUNTIME(12328,python):2024-07-31-09:34:15.289.993 [api_c.cc:3130]12328 rtSetOpExecuteTimeOut:[INIT][DEFAULT]ErrCode=107020, desc=[task timeout], InnerCode=0x7150059 [ERROR] RUNTIME(12328,python):2024-07-31-09:34:15.290.000 [error_message_manage.cc:53]12328 FuncErrorReason:[INIT][DEFAULT]report error module_type=3, module_name=EE8888 [ERROR] RUNTIME(12328,python):2024-07-31-09:34:15.290.012 [error_message_manage.cc:53]12328 FuncErrorReason:[INIT][DEFAULT]rtSetOpExecuteTimeOut execute failed, reason=[task timeout] [ERROR] ASCENDCL(12328,python):2024-07-31-09:34:15.290.077 [event.cpp:261]12328 aclrtSetOpExecuteTimeOut: [INIT][DEFAULT]set op execute timeout failed, runtime result = 107020 ``` </details> - `log/run/plog/plog-12328_20240731093348072.log` <details> ```txt [INFO] PROFILING(12328,python):2024-07-31-09:33:47.897.041 [prof_atls_plugin.cpp:83] >>> (tid:12328) RegisterProfileCallback, callback type is 7 [INFO] PROFILING(12328,python):2024-07-31-09:33:47.897.073 [prof_atls_plugin.cpp:83] >>> (tid:12328) RegisterProfileCallback, callback type is 8 [INFO] ATRACE(12328,python):2024-07-31-09:33:47.919.880 [trace_attr.c:187](tid:12328) attr init success, timeout=0. [INFO] ATRACE(12328,python):2024-07-31-09:33:47.919.904 [trace_recorder.c:121](tid:12328) use root path: /root/ascend [INFO] RUNTIME(12328,python):2024-07-31-09:33:48.202.281 [runtime.cc:5211] 12328 GetVisibleDevices: real deviceCnt:1 userDeviceCnt:1 isSetVisibleDev:1 ASCEND_RT_VISIBLE_DEVICES:0 [INFO] PROFILING(12328,python):2024-07-31-09:33:48.205.198 [prof_atls_plugin.cpp:160] >>> (tid:12328) Module[7] register callback of ctrl handle. [INFO] PROFILING(12328,python):2024-07-31-09:33:48.642.524 [prof_atls_plugin.cpp:160] >>> (tid:12328) Module[61] register callback of ctrl handle. [INFO] IDEDD(12328,python):2024-07-31-09:33:48.694.841 [adx_dump_record.cpp:221][tid:12521]>>> start dump thread, remote dump record temp path : /root/. [INFO] IDEDD(12328,python):2024-07-31-09:33:48.694.897 [adx_server_manager.cpp:209][tid:12522]>>> Run Server(0) Process [INFO] IDEDD(12328,python):2024-07-31-09:33:48.694.956 [hdc_comm_opt.cpp:59][tid:12522]>>> open device[0] server[13] [INFO] PROFILING(12328,python):2024-07-31-09:33:48.694.977 [prof_atls_plugin.cpp:160] >>> (tid:12328) Module[48] register callback of ctrl handle. [INFO] PROFILING(12328,python):2024-07-31-09:33:48.694.996 [prof_atls_plugin.cpp:160] >>> (tid:12328) Module[45] register callback of ctrl handle. [INFO] IDEDD(12328,python):2024-07-31-09:33:48.695.101 [hdc_api.cpp:119][tid:12522]>>> logDevId 0 create HDC server successfully [INFO] GE(12328,python):2024-07-31-09:33:48.881.986 [op_tiling_manager.cc:102][EVENT]12328 ~FuncPerfScope:[GEPERFTRACE] The time cost of OpTilingManager::LoadSo is [186976] micro second. [INFO] PROFILING(12328,python):2024-07-31-09:33:48.897.469 [prof_atls_plugin.cpp:160] >>> (tid:12328) Module[6] register callback of ctrl handle. [INFO] TDT(12328,python):2024-07-31-09:33:49.552.031 [client_manager.cpp:397][IsHostEnvironment][tid:12328] [TsdClient] logicDeviceId is [0], hostaicpunum[0] [INFO] TDT(12328,python):2024-07-31-09:33:49.552.050 [client_manager.cpp:426][GetClientRunMode][tid:12328] runningMode:0 [INFO] TDT(12328,python):2024-07-31-09:33:49.552.054 [client_manager.cpp:104][GetInstance][tid:12328] curmode:1 [INFO] TDT(12328,python):2024-07-31-09:33:49.552.154 [process_mode_manager.cpp:127][OpenProcess][tid:12328] [ProcessModeManager] enter into open process deviceId[0] rankSize[0] [INFO] TDT(12328,python):2024-07-31-09:33:49.552.675 [process_mode_manager.cpp:418][InitTsdClient][tid:12328] [TsdClient] deviceId[0] begin to init hdc client [INFO] TDT(12328,python):2024-07-31-09:33:49.552.765 [version_verify.cpp:34][SetVersionInfo][tid:12328] VersionVerify: send client version to server [INFO] TDT(12328,python):2024-07-31-09:33:49.552.786 [version_verify.cpp:50][SetVersionInfo][tid:12328] send feature_info:{msg_type:35, features:{check before send aicpu package,}} [INFO] TDT(12328,python):2024-07-31-09:33:49.552.794 [version_verify.cpp:50][SetVersionInfo][tid:12328] send feature_info:{msg_type:37, features:{check before send open qs message,}} [INFO] TDT(12328,python):2024-07-31-09:33:49.553.070 [version_verify.cpp:66][PeerVersionCheck][tid:12328] VersionVerify: Check client version info, server[1230], client[1230] [INFO] TDT(12328,python):2024-07-31-09:33:49.553.079 [version_verify.cpp:87][ParseVersionInfo][tid:12328] VersionVerify: pass client version info success [INFO] TDT(12328,python):2024-07-31-09:33:49.553.083 [hdc_client.cpp:277][CheckHdcConnection][tid:12328] Service[2] create hdc success [INFO] TDT(12328,python):2024-07-31-09:33:49.553.093 [version_verify.cpp:120][SpecialFeatureCheck][tid:12328] VersionVerify: new type[35], supported [INFO] TDT(12328,python):2024-07-31-09:33:49.553.133 [process_mode_manager.cpp:821][GetDeviceCheckCode][tid:12328] [TsdClient][deviceId=0] [sessionId=1] wait package info respond [INFO] TDT(12328,python):2024-07-31-09:33:49.614.632 [process_mode_manager.cpp:1916][SendExtendPackage][tid:12328] device not support extend pkg skip send [INFO] TDT(12328,python):2024-07-31-09:33:49.614.666 [process_mode_manager.cpp:418][InitTsdClient][tid:12328] [TsdClient] deviceId[0] begin to init hdc client [INFO] TDT(12328,python):2024-07-31-09:33:49.614.804 [version_verify.cpp:34][SetVersionInfo][tid:12328] VersionVerify: send client version to server [INFO] TDT(12328,python):2024-07-31-09:33:49.614.818 [version_verify.cpp:50][SetVersionInfo][tid:12328] send feature_info:{msg_type:35, features:{check before send aicpu package,}} [INFO] TDT(12328,python):2024-07-31-09:33:49.614.826 [version_verify.cpp:50][SetVersionInfo][tid:12328] send feature_info:{msg_type:37, features:{check before send open qs message,}} [INFO] TDT(12328,python):2024-07-31-09:33:49.629.791 [version_verify.cpp:66][PeerVersionCheck][tid:12328] VersionVerify: Check client version info, server[1230], client[1230] [INFO] TDT(12328,python):2024-07-31-09:33:49.629.801 [version_verify.cpp:87][ParseVersionInfo][tid:12328] VersionVerify: pass client version info success [INFO] TDT(12328,python):2024-07-31-09:33:49.629.804 [hdc_client.cpp:277][CheckHdcConnection][tid:12328] Service[2] create hdc success [INFO] TDT(12328,python):2024-07-31-09:33:49.629.814 [process_mode_manager.cpp:465][ConstructOpenMsg][tid:12328] [TsdClient] tsd get process sign successfully, procpid[3811976] signSize[48] [INFO] TDT(12328,python):2024-07-31-09:33:49.629.823 [version_verify.cpp:112][SpecialFeatureCheck][tid:12328] VersionVerify: previous type[6], supported [INFO] TDT(12328,python):2024-07-31-09:33:49.629.840 [process_mode_manager.cpp:144][OpenProcess][tid:12328] [ProcessModeManager] deviceId[0] sessionId[1] rankSize[0], wait sub process start respond [INFO] TDT(12328,python):2024-07-31-09:33:52.631.185 [stub_process_mode_nowin.cpp:63][ProcessQueueForMdc][tid:12328] [TsdClient] it is unnecessary of current mode[0] chiptype[5] to grant queue auth to aicpusd [INFO] TDT(12328,python):2024-07-31-09:33:52.631.205 [stub_process_mode_nowin.cpp:101][OpenInHost][tid:12328] enter into OpenInHost deviceid[0] [INFO] TDT(12328,python):2024-07-31-09:33:52.631.235 [client_manager.cpp:397][IsHostEnvironment][tid:12328] [TsdClient] logicDeviceId is [0], hostaicpunum[0] [INFO] TDT(12328,python):2024-07-31-09:33:52.631.241 [stub_process_mode_nowin.cpp:105][OpenInHost][tid:12328] host cpu not support [INFO] TDT(12328,python):2024-07-31-09:33:52.631.244 [process_mode_manager.cpp:178][OpenProcess][tid:12328] [TsdClient][deviceId=0] [sessionId=1] start hccp and computer process success [INFO] RUNTIME(12328,python):2024-07-31-09:33:52.634.900 [device.cc:343] 12328 Init: isAddrFlat:0 [INFO] TDT(12328,python):2024-07-31-09:33:52.635.761 [tsd_client.cpp:182][TsdCapabilityGet][tid:12328] TsdCapabilityGet Begin. [INFO] TDT(12328,python):2024-07-31-09:33:52.635.771 [process_mode_manager.cpp:1128][CapabilityGet][tid:12328] [ProcessModeManager] enter into CapabilityGet process deviceId[0] type[0] [INFO] TDT(12328,python):2024-07-31-09:33:52.635.782 [version_verify.cpp:112][SpecialFeatureCheck][tid:12328] VersionVerify: previous type[38], supported [INFO] TDT(12328,python):2024-07-31-09:33:52.635.814 [process_mode_manager.cpp:1151][CapabilityGet][tid:12328] [TsdClient][deviceId=0] [sessionId=1] [type=0]send capability success [INFO] TDT(12328,python):2024-07-31-09:33:52.635.953 [process_mode_manager.cpp:691][PidQosMsgProc][tid:12328] [TsdClient] PidQosMsgProc recvMsg realDeviceId[0] msgType[39] localDevId[0] rspCode[0],pidqos[1] [INFO] TDT(12328,python):2024-07-31-09:33:52.635.960 [process_mode_manager.cpp:1156][CapabilityGet][tid:12328] [TsdClient][logicDeviceId_=0][type=0][pidQos=1][ret=0]recv capability respond finish [INFO] RUNTIME(12328,python):2024-07-31-09:33:52.650.576 [npu_driver.cc:5571] 12525 GetDeviceStatus: GetDeviceStatus status=1. [INFO] ATRACE(12328,python):2024-07-31-09:33:52.651.356 [tracer_mgr_operate.c:59](tid:12328) create object RUNTIME_ATRACE_DEV0_TS0 success, exitSave(false). [INFO] TDT(12328,python):2024-07-31-09:33:52.651.369 [client_manager.cpp:164][SetProfilingCallback][tid:12328] [TsdClient] set profiling callback success [INFO] GE(12328,python):2024-07-31-09:33:52.658.772 [ge_api.cc:175][status:INIT]12328 GEInitializeImpl:GEInitialize start [INFO] GE(12328,python):2024-07-31-09:33:52.658.787 [ge_api.cc:189][EVENT]12328 GEInitializeImpl:[GEPERFTRACE] The time cost of GEInitialize::GEAPICheckSupportedGlobalOptions is [7] micro second. [INFO] GE(12328,python):2024-07-31-09:33:52.685.373 [ge_api.cc:206][EVENT]12328 GEInitializeImpl:[GEPERFTRACE] The time cost of GEInitialize::CheckOptionsValid is [52] micro second. [INFO] GE(12328,python):2024-07-31-09:33:52.920.695 [ge_api.cc:221][EVENT]12328 GEInitializeImpl:[GEPERFTRACE] The time cost of GEInitialize::ManagerInitialize is [233964] micro second. [INFO] GE(12328,python):2024-07-31-09:33:52.920.870 [ge_api.cc:236][EVENT]12328 GEInitializeImpl:[GEPERFTRACE] The time cost of GEInitialize::InitProfiling is [149] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.002.846 [ge_api.cc:246][EVENT]12328 GEInitializeImpl:[GEPERFTRACE] The time cost of GEInitialize::InitPreparation is [81872] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.002.865 [gelib.cc:91][EVENT]12328 Initialize:[GEPERFTRACE] GE Init Start [INFO] GE(12328,python):2024-07-31-09:33:53.191.801 [gelib.cc:157][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of GELib::InitializePrepare is [188928] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.192.357 [gelib.cc:312][EVENT]12328 SystemInitialize:Infer init GELib success, device id :-1 [INFO] GE(12328,python):2024-07-31-09:33:53.192.366 [gelib.cc:184][EVENT]12328 InnerInitialize:[GEPERFTRACE] The time cost of InnerInitialize::SystemInitialize is [14] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.258.766 [process_node_engine_manager.cc:63][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of ProcessNodeEngineManager::Initialize[HOST_CPU] is [2] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.258.790 [process_node_engine_manager.cc:63][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of ProcessNodeEngineManager::Initialize[NPU] is [2] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.258.796 [process_node_engine_manager.cc:63][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of ProcessNodeEngineManager::Initialize[PS] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.258.800 [process_node_engine_manager.cc:63][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of ProcessNodeEngineManager::Initialize[UDF] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.258.808 [gelib.cc:208][EVENT]12328 InnerInitialize:[GEPERFTRACE] The time cost of InnerInitialize::ProcessNodeEngine is [66016] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.260.441 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetDNNEngineObjs] in [libengine.so] is [124] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.260.452 [dnnengine_manager.cc:128][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of DNNEngineManager::Initialize[AIcoreEngine] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.260.460 [dnnengine_manager.cc:128][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of DNNEngineManager::Initialize[DNN_HCCL] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.260.465 [dnnengine_manager.cc:128][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of DNNEngineManager::Initialize[DNN_VM_AICPU] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.260.469 [dnnengine_manager.cc:128][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of DNNEngineManager::Initialize[DNN_VM_AICPU_ASCEND] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.260.473 [dnnengine_manager.cc:128][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of DNNEngineManager::Initialize[DNN_VM_AICPU_ASCEND_FFTS_PLUS] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.260.477 [dnnengine_manager.cc:128][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of DNNEngineManager::Initialize[DNN_VM_AICPU_FFTS_PLUS] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.260.481 [dnnengine_manager.cc:128][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of DNNEngineManager::Initialize[DNN_VM_DVPP] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.260.485 [dnnengine_manager.cc:128][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of DNNEngineManager::Initialize[DNN_VM_GE_LOCAL] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.260.488 [dnnengine_manager.cc:128][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of DNNEngineManager::Initialize[DNN_VM_HOST_CPU] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.260.492 [dnnengine_manager.cc:128][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of DNNEngineManager::Initialize[DNN_VM_RTS] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.260.495 [dnnengine_manager.cc:128][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of DNNEngineManager::Initialize[DNN_VM_RTS_FFTS_PLUS] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.260.499 [dnnengine_manager.cc:128][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of DNNEngineManager::Initialize[DSAEngine] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.260.502 [dnnengine_manager.cc:128][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of DNNEngineManager::Initialize[VectorEngine] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.260.505 [dnnengine_manager.cc:128][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of DNNEngineManager::Initialize[ffts_plus] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.261.248 [gelib.cc:219][EVENT]12328 InnerInitialize:[GEPERFTRACE] The time cost of InnerInitialize::EngineInitialize is [2433] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.263.288 [op_tiling_manager.cc:102][EVENT]12328 ~FuncPerfScope:[GEPERFTRACE] The time cost of OpTilingManager::LoadSo is [1812] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.587.199 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/libfe.so] is [323841] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.590.065 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/libge_local_engine.so] is [2776] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.606.122 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/librts_engine.so] is [16013] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.630.869 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/libaicpu_ascend_engine.so] is [24700] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.634.981 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/libhost_cpu_engine.so] is [4068] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.653.225 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/libaicpu_tf_engine.so] is [18200] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.686.425 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/libffts.so] is [33154] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.691.062 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/libdvpp_engine.so] is [4587] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.730.484 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/libhcom_graph_adaptor.so] is [39377] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.730.514 [ops_kernel_manager.cc:78][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of OpsKernelManager::LoadPluginManagerSo is [467213] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.920.179 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [Initialize] in [libaicpu_ascend_engine.so] is [189647] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.920.699 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [Initialize] in [libaicpu_tf_engine.so] is [501] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.920.735 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [Initialize] in [libdvpp_engine.so] is [26] micro second. [INFO] ATRACE(12328,python):2024-07-31-09:33:53.920.832 [tracer_mgr_operate.c:59](tid:12328) create object FE_Global_Trace success, exitSave(false). [INFO] ATRACE(12328,python):2024-07-31-09:33:53.920.893 [tracer_mgr_operate.c:59](tid:12328) create object FE_Statistics_Trace success, exitSave(false). [INFO] TUNE(12328,python):2024-07-31-09:33:53.926.522 [cann_kb_pyfunc_mgr.cpp:72][CANNKB][Tid:12328]"CannKbPyfuncMgr: Enter PyObjectInit, reference_ is 0!" [INFO] TUNE(12328,python):2024-07-31-09:33:53.926.545 [handle_manager.cpp:115][CANNKB][Tid:12328]"Start to run init functions to load dynamic python lib!" [INFO] TUNE(12328,python):2024-07-31-09:33:53.926.608 [handle_manager.cpp:407][CANNKB][Tid:12328]"Init functions of loading dynamic python lib end!" [INFO] TUNE(12328,python):2024-07-31-09:33:53.926.613 [cann_kb_pyfunc_mgr.cpp:24][CANNKB][Tid:12328]"CANN_KB_Py has already been initialized." [INFO] TUNE(12328,python):2024-07-31-09:34:00.442.316 [cann_kb_pyfunc_mgr.cpp:117][CANNKB][Tid:12328]"CannKbPyfuncMgr: Run PyObjectInit successfully!" [INFO] GE(12328,python):2024-07-31-09:34:03.730.090 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [Initialize] in [libfe.so] is [9809329] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.937.925 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [Initialize] in [libffts.so] is [207778] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.938.001 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [Initialize] in [libge_local_engine.so] is [23] micro second. [INFO] HCCL(12328,python):2024-07-31-09:34:03.938.041 [plugin_manager.cc:42][12328]hcom running normal mode. [INFO] GE(12328,python):2024-07-31-09:34:03.938.299 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [Initialize] in [libhcom_graph_adaptor.so] is [291] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.938.566 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [Initialize] in [libhost_cpu_engine.so] is [259] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.938.640 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [Initialize] in [librts_engine.so] is [67] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.938.706 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetOpsKernelInfoStores] in [libaicpu_ascend_engine.so] is [54] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.938.740 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetOpsKernelInfoStores] in [libaicpu_tf_engine.so] is [28] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.938.771 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetOpsKernelInfoStores] in [libdvpp_engine.so] is [26] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.938.817 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetOpsKernelInfoStores] in [libfe.so] is [41] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.938.824 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetOpsKernelInfoStores] in [libffts.so] is [2] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.938.839 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetOpsKernelInfoStores] in [libge_local_engine.so] is [11] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.938.881 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetOpsKernelInfoStores] in [libhcom_graph_adaptor.so] is [22] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.938.893 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetOpsKernelInfoStores] in [libhost_cpu_engine.so] is [7] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.938.913 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetOpsKernelInfoStores] in [librts_engine.so] is [16] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.938.941 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetGraphOptimizerObjs] in [libaicpu_ascend_engine.so] is [22] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.938.955 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetGraphOptimizerObjs] in [libaicpu_tf_engine.so] is [11] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.938.974 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetGraphOptimizerObjs] in [libdvpp_engine.so] is [14] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.022 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetGraphOptimizerObjs] in [libfe.so] is [45] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.038 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetGraphOptimizerObjs] in [libffts.so] is [10] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.055 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetGraphOptimizerObjs] in [libge_local_engine.so] is [12] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.084 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetGraphOptimizerObjs] in [libhcom_graph_adaptor.so] is [25] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.094 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetGraphOptimizerObjs] in [libhost_cpu_engine.so] is [6] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.105 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetGraphOptimizerObjs] in [librts_engine.so] is [7] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.119 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetCompositeEngines] in [libaicpu_ascend_engine.so] is [9] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.124 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetCompositeEngines] in [libaicpu_tf_engine.so] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.129 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetCompositeEngines] in [libdvpp_engine.so] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.135 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetCompositeEngines] in [libfe.so] is [3] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.315 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetCompositeEngines] in [libffts.so] is [175] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.323 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetCompositeEngines] in [libge_local_engine.so] is [2] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.349 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetCompositeEngines] in [libhcom_graph_adaptor.so] is [9] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.354 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetCompositeEngines] in [libhost_cpu_engine.so] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.358 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetCompositeEngines] in [librts_engine.so] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.366 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetFFTSPlusSwitch] in [libaicpu_ascend_engine.so] is [3] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.370 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetFFTSPlusSwitch] in [libaicpu_tf_engine.so] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.374 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetFFTSPlusSwitch] in [libdvpp_engine.so] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.380 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetFFTSPlusSwitch] in [libfe.so] is [2] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.438 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetFFTSPlusSwitch] in [libffts.so] is [55] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.444 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetFFTSPlusSwitch] in [libge_local_engine.so] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.452 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetFFTSPlusSwitch] in [libhcom_graph_adaptor.so] is [3] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.456 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetFFTSPlusSwitch] in [libhost_cpu_engine.so] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.460 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetFFTSPlusSwitch] in [librts_engine.so] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.470 [ops_kernel_manager.cc:153][EVENT]12328 InitOpKernelInfoStores:[GEPERFTRACE] The time cost of InitOpKernelInfoStores::Initialize[AIcoreEngine] is [2] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.654 [ops_kernel_manager.cc:153][EVENT]12328 InitOpKernelInfoStores:[GEPERFTRACE] The time cost of InitOpKernelInfoStores::Initialize[DNN_VM_GE_LOCAL_OP_STORE] is [179] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.963.392 [ops_kernel_manager.cc:153][EVENT]12328 InitOpKernelInfoStores:[GEPERFTRACE] The time cost of InitOpKernelInfoStores::Initialize[DNN_VM_HOST_CPU_OP_STORE] is [23726] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.963.532 [ops_kernel_manager.cc:153][EVENT]12328 InitOpKernelInfoStores:[GEPERFTRACE] The time cost of InitOpKernelInfoStores::Initialize[DNN_VM_RTS_FFTS_PLUS_OP_STORE] is [115] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.963.634 [ops_kernel_manager.cc:153][EVENT]12328 InitOpKernelInfoStores:[GEPERFTRACE] The time cost of InitOpKernelInfoStores::Initialize[DNN_VM_RTS_OP_STORE] is [94] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.963.641 [ops_kernel_manager.cc:153][EVENT]12328 InitOpKernelInfoStores:[GEPERFTRACE] The time cost of InitOpKernelInfoStores::Initialize[DSAEngine] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.029.205 [ops_kernel_manager.cc:153][EVENT]12328 InitOpKernelInfoStores:[GEPERFTRACE] The time cost of InitOpKernelInfoStores::Initialize[aicpu_ascend_kernel] is [65553] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.285.971 [ops_kernel_manager.cc:153][EVENT]12328 InitOpKernelInfoStores:[GEPERFTRACE] The time cost of InitOpKernelInfoStores::Initialize[aicpu_tf_kernel] is [256733] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.312.571 [ops_kernel_manager.cc:153][EVENT]12328 InitOpKernelInfoStores:[GEPERFTRACE] The time cost of InitOpKernelInfoStores::Initialize[dvpp_ops_kernel] is [26573] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.312.586 [ops_kernel_manager.cc:153][EVENT]12328 InitOpKernelInfoStores:[GEPERFTRACE] The time cost of InitOpKernelInfoStores::Initialize[ops_kernel_info_hccl] is [3] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.312.593 [graph_builder.cc:102][EVENT]12328 ~FuncPerfScope:[GEPERFTRACE] The time cost of OpsKernelManager::InitOpKernelInfoStores is [373127] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.318.813 [ops_kernel_manager.cc:174][EVENT]12328 InitOpsKernelInfo:[GEPERFTRACE] The time cost of InitOpsKernelInfo::GetAllOpsKernelInfo[AIcoreEngine] is [6212] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.320.411 [ops_kernel_manager.cc:174][EVENT]12328 InitOpsKernelInfo:[GEPERFTRACE] The time cost of InitOpsKernelInfo::GetAllOpsKernelInfo[DNN_VM_GE_LOCAL_OP_STORE] is [59] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.320.626 [ops_kernel_manager.cc:174][EVENT]12328 InitOpsKernelInfo:[GEPERFTRACE] The time cost of InitOpsKernelInfo::GetAllOpsKernelInfo[DNN_VM_HOST_CPU_OP_STORE] is [95] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.320.759 [ops_kernel_manager.cc:174][EVENT]12328 InitOpsKernelInfo:[GEPERFTRACE] The time cost of InitOpsKernelInfo::GetAllOpsKernelInfo[DNN_VM_RTS_FFTS_PLUS_OP_STORE] is [12] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.320.810 [ops_kernel_manager.cc:174][EVENT]12328 InitOpsKernelInfo:[GEPERFTRACE] The time cost of InitOpsKernelInfo::GetAllOpsKernelInfo[DNN_VM_RTS_OP_STORE] is [26] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.320.895 [ops_kernel_manager.cc:174][EVENT]12328 InitOpsKernelInfo:[GEPERFTRACE] The time cost of InitOpsKernelInfo::GetAllOpsKernelInfo[DSAEngine] is [33] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.321.138 [ops_kernel_manager.cc:174][EVENT]12328 InitOpsKernelInfo:[GEPERFTRACE] The time cost of InitOpsKernelInfo::GetAllOpsKernelInfo[aicpu_ascend_kernel] is [224] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.322.000 [ops_kernel_manager.cc:174][EVENT]12328 InitOpsKernelInfo:[GEPERFTRACE] The time cost of InitOpsKernelInfo::GetAllOpsKernelInfo[aicpu_tf_kernel] is [524] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.323.018 [ops_kernel_manager.cc:174][EVENT]12328 InitOpsKernelInfo:[GEPERFTRACE] The time cost of InitOpsKernelInfo::GetAllOpsKernelInfo[dvpp_ops_kernel] is [23] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.323.173 [ops_kernel_manager.cc:174][EVENT]12328 InitOpsKernelInfo:[GEPERFTRACE] The time cost of InitOpsKernelInfo::GetAllOpsKernelInfo[ops_kernel_info_hccl] is [109] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.324.231 [graph_builder.cc:102][EVENT]12328 ~FuncPerfScope:[GEPERFTRACE] The time cost of OpsKernelManager::InitOpsKernelInfo is [11631] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.553.111 [ops_kernel_manager.cc:245][EVENT]12328 InitGraphOptimizers:[GEPERFTRACE] The time cost of InitGraphOptimizers::Initialize[AIcoreEngine] is [228841] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.554.749 [ops_kernel_manager.cc:245][EVENT]12328 InitGraphOptimizers:[GEPERFTRACE] The time cost of InitGraphOptimizers::Initialize[DNN_VM_HOST_CPU_OPTIMIZER] is [1610] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.554.784 [ops_kernel_manager.cc:245][EVENT]12328 InitGraphOptimizers:[GEPERFTRACE] The time cost of InitGraphOptimizers::Initialize[DNN_VM_RTS_FFTS_PLUS_GRAPH_OPTIMIZER_STORE] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.554.814 [ops_kernel_manager.cc:245][EVENT]12328 InitGraphOptimizers:[GEPERFTRACE] The time cost of InitGraphOptimizers::Initialize[DNN_VM_RTS_GRAPH_OPTIMIZER_STORE] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.554.821 [ops_kernel_manager.cc:245][EVENT]12328 InitGraphOptimizers:[GEPERFTRACE] The time cost of InitGraphOptimizers::Initialize[DSAEngine] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.556.333 [ops_kernel_manager.cc:245][EVENT]12328 InitGraphOptimizers:[GEPERFTRACE] The time cost of InitGraphOptimizers::Initialize[aicpu_ascend_optimizer] is [1505] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.559.896 [ops_kernel_manager.cc:245][EVENT]12328 InitGraphOptimizers:[GEPERFTRACE] The time cost of InitGraphOptimizers::Initialize[aicpu_tf_optimizer] is [3550] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.559.969 [ops_kernel_manager.cc:245][EVENT]12328 InitGraphOptimizers:[GEPERFTRACE] The time cost of InitGraphOptimizers::Initialize[dvpp_graph_optimizer] is [25] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.089 [ops_kernel_manager.cc:245][EVENT]12328 InitGraphOptimizers:[GEPERFTRACE] The time cost of InitGraphOptimizers::Initialize[ffts_plus] is [112] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.097 [ops_kernel_manager.cc:245][EVENT]12328 InitGraphOptimizers:[GEPERFTRACE] The time cost of InitGraphOptimizers::Initialize[ge_local_graph_optimizer] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.135 [ops_kernel_manager.cc:245][EVENT]12328 InitGraphOptimizers:[GEPERFTRACE] The time cost of InitGraphOptimizers::Initialize[hccl_alltoallvc_fusion_optimizer] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.188 [ops_kernel_manager.cc:245][EVENT]12328 InitGraphOptimizers:[GEPERFTRACE] The time cost of InitGraphOptimizers::Initialize[hccl_graph_optimizer] is [27] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.194 [graph_builder.cc:102][EVENT]12328 ~FuncPerfScope:[GEPERFTRACE] The time cost of OpsKernelManager::InitGraphOptimizers is [235955] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.201 [ops_kernel_manager.cc:365][EVENT]12328 ClassifyGraphOptimizers:[GEPERFTRACE] The time cost of ClassifyGraphOptimizers::GetAttributes[AIcoreEngine] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.208 [ops_kernel_manager.cc:365][EVENT]12328 ClassifyGraphOptimizers:[GEPERFTRACE] The time cost of ClassifyGraphOptimizers::GetAttributes[DNN_VM_HOST_CPU_OPTIMIZER] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.213 [ops_kernel_manager.cc:365][EVENT]12328 ClassifyGraphOptimizers:[GEPERFTRACE] The time cost of ClassifyGraphOptimizers::GetAttributes[DNN_VM_RTS_FFTS_PLUS_GRAPH_OPTIMIZER_STORE] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.218 [ops_kernel_manager.cc:365][EVENT]12328 ClassifyGraphOptimizers:[GEPERFTRACE] The time cost of ClassifyGraphOptimizers::GetAttributes[DNN_VM_RTS_GRAPH_OPTIMIZER_STORE] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.223 [ops_kernel_manager.cc:365][EVENT]12328 ClassifyGraphOptimizers:[GEPERFTRACE] The time cost of ClassifyGraphOptimizers::GetAttributes[DSAEngine] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.228 [ops_kernel_manager.cc:365][EVENT]12328 ClassifyGraphOptimizers:[GEPERFTRACE] The time cost of ClassifyGraphOptimizers::GetAttributes[aicpu_ascend_optimizer] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.232 [ops_kernel_manager.cc:365][EVENT]12328 ClassifyGraphOptimizers:[GEPERFTRACE] The time cost of ClassifyGraphOptimizers::GetAttributes[aicpu_tf_optimizer] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.237 [ops_kernel_manager.cc:365][EVENT]12328 ClassifyGraphOptimizers:[GEPERFTRACE] The time cost of ClassifyGraphOptimizers::GetAttributes[dvpp_graph_optimizer] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.241 [ops_kernel_manager.cc:365][EVENT]12328 ClassifyGraphOptimizers:[GEPERFTRACE] The time cost of ClassifyGraphOptimizers::GetAttributes[ffts_plus] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.246 [ops_kernel_manager.cc:365][EVENT]12328 ClassifyGraphOptimizers:[GEPERFTRACE] The time cost of ClassifyGraphOptimizers::GetAttributes[ge_local_graph_optimizer] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.250 [ops_kernel_manager.cc:365][EVENT]12328 ClassifyGraphOptimizers:[GEPERFTRACE] The time cost of ClassifyGraphOptimizers::GetAttributes[hccl_alltoallvc_fusion_optimizer] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.254 [ops_kernel_manager.cc:365][EVENT]12328 ClassifyGraphOptimizers:[GEPERFTRACE] The time cost of ClassifyGraphOptimizers::GetAttributes[hccl_graph_optimizer] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.258 [graph_builder.cc:102][EVENT]12328 ~FuncPerfScope:[GEPERFTRACE] The time cost of OpsKernelManager::ClassifyGraphOptimizers is [58] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.561.775 [proto_util.cc:102][EVENT]12328 ~FuncPerfScope:[GEPERFTRACE] The time cost of ReadProtoFromText::/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/optimizer_priority.pbtxt is [999] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.561.827 [graph_builder.cc:102][EVENT]12328 ~FuncPerfScope:[GEPERFTRACE] The time cost of OpsKernelManager::InitGraphOptimizerPriority is [1565] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.561.929 [gelib.cc:231][EVENT]12328 InnerInitialize:[GEPERFTRACE] The time cost of InnerInitialize::OpsManagerInitialize is [11300665] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.564.730 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/libge_local_opskernel_builder.so] is [2665] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.566.913 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/libhost_cpu_opskernel_builder.so] is [2136] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.566.979 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/librts_engine.so] is [26] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.567.015 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/libaicpu_ascend_engine.so] is [10] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.567.053 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/libaicpu_tf_engine.so] is [14] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.567.087 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/libdvpp_engine.so] is [9] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.578.024 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/libhcom_opskernel_builder.so] is [10910] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.581.672 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/libhvd_opskernel_builder.so] is [3587] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.584.532 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/libhcom_gradtune_opskernel_builder.so] is [2817] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.586.183 [gelib.cc:243][EVENT]12328 InnerInitialize:[GEPERFTRACE] The time cost of InnerInitialize::OpsKernelBuilderManager is [24203] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.586.202 [gelib.cc:254][EVENT]12328 InnerInitialize:[GEPERFTRACE] The time cost of InnerInitialize::HostCpuEngineInitialize is [10] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.586.247 [gelib.cc:265][EVENT]12328 InnerInitialize:[GEPERFTRACE] The time cost of InnerInitialize::AnalyzerInitialize is [40] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.586.261 [gelib.cc:168][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of GELib::Initialize is [11394447] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.586.302 [ge_api.cc:252][EVENT]12328 GEInitializeImpl:[GEPERFTRACE] The time cost of GEInitialize::GELibInitialize is [11583438] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.586.324 [ge_api.cc:268][EVENT]12328 GEInitializeImpl:[GEPERFTRACE] The time cost of InnerInitialize::SessionManagerInitialize is [10] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.586.331 [ge_api.cc:285][EVENT]12328 GEInitializeImpl:[GEPERFTRACE] The time cost of GeExecutor::Initialize is [2] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.586.363 [ge_api.cc:288][EVENT]12328 GEInitializeImpl:[GEPERFTRACE] The time cost of InitializeExecutionRuntime is [28] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.586.367 [ge_api.cc:294][status:STOP]12328 GEInitializeImpl:GEInitialize finished [INFO] GE(12328,python):2024-07-31-09:34:04.586.379 [ge_api.cc:295][EVENT]12328 GEInitializeImpl:[GEPERFTRACE] The time cost of GEInitialize::All is [11927610] micro second. [INFO] RUNTIME(12328,python):2024-07-31-09:34:15.289.716 [runtime.cc:5551] 12328 SetWatchDogDevStatus: There is errInfo of devId=0, tsId=0 [INFO] IDEDD(12328,python):2024-07-31-09:34:18.093.784 [adx_server_manager.cpp:49][tid:12328]>>> start to deconstruct adx server manager [INFO] IDEDD(12328,python):2024-07-31-09:34:18.396.287 [adx_server_manager.cpp:241][tid:12522]>>> server manager stop [INFO] IDEDD(12328,python):2024-07-31-09:34:18.672.674 [adx_server_manager.cpp:49][tid:12328]>>> start to deconstruct adx server manager [INFO] RUNTIME(12328,python):2024-07-31-09:34:18.672.921 [runtime.cc:1873] 12328 ~Runtime: deconstruct runtime [INFO] RUNTIME(12328,python):2024-07-31-09:34:18.672.928 [runtime.cc:1880] 12328 ~Runtime: wait monitor success, use=0. [INFO] ATRACE(12328,python):2024-07-31-09:34:18.674.145 [tracer_mgr_operate.c:137](tid:12328) destory object RUNTIME_ATRACE_DEV0_TS0, exitSave(false). ``` - ACLHelloWorld 运行结果 <details> ```bash (base) [root@devserver-bms-c4907478-tmp0630 samples-master]# cd inference/ACLHelloWorld/scripts/ (base) [root@devserver-bms-c4907478-tmp0630 scripts]# bash sample_run.sh [INFO] The sample starts to run [INFO] Acl Init Success [INFO] Acl Set Device Success,Current DeviceID:0 [INFO] Acl Create Context Success [INFO] Acl Create Stream Success [INFO] Acl Destroy Stream Success [INFO] Acl Destroy Context success [INFO] Acl Reset Device Success [INFO] Acl Finalize Success [INFO] The program runs successfully ``` </details>
# 问题现象（附报错日志上下文） torch_npu 在虚拟化的 901B 设备上初始化报错，在正常的 910B 设备上初始化没有出现问题。该虚拟化设备可以正常运行 [ACLHelloWorld 示例代码](https://gitee.com/ascend/samples/tree/master/inference/ACLHelloWorld)。 - 虚拟化的参考文档：[虚拟化实例](https://www.hiascend.com/document/detail/zh/computepoweralloca/300/cpaug/cpaug/cpaug_00001.html) 运行代码： ```py # mini-demo.py import torch import torch_npu print(torch.npu.is_available()) print(torch.npu.device_count()) a = torch.randn(2,3).npu() print(a) ``` 报错信息： ```sh $ python mini-demo.py True 1 Traceback (most recent call last): File "/root/mini-demo.py", line 4, in <module> a = torch.randn(2,3).npu() File "/home/ems/miniconda3/lib/python3.10/site-packages/torch/utils/backend_registration.py", line 153, in wrap_tensor_to device_idx = _normalization_device(custom_backend_name, device) File "/home/ems/miniconda3/lib/python3.10/site-packages/torch/utils/backend_registration.py", line 109, in _normalization_device return _get_current_device_index() File "/home/ems/miniconda3/lib/python3.10/site-packages/torch/utils/backend_registration.py", line 103, in _get_current_device_index return getattr(getattr(torch, custom_backend_name), _get_device_index)() File "/home/ems/miniconda3/lib/python3.10/site-packages/torch_npu/npu/utils.py", line 59, in current_device torch_npu.npu._lazy_init() File "/home/ems/miniconda3/lib/python3.10/site-packages/torch_npu/npu/__init__.py", line 214, in _lazy_init torch_npu._C._npu_init() RuntimeError: Initialize:build/CMakeFiles/torch_npu.dir/compiler_depend.ts:227 NPU error, error code is 107020. E39999: Inner Error! E39999: 2024-07-31-09:34:15.289.596 The error from device(chipId:7, dieId:0), serial number is 27, an exception occurred during AICPU execution, stream_id:0, task_id:3, errcode:135175, msg:aicpu execute failed..[FUNC:ProcessStarsAicpuErrorInfo][FILE:device_error_proc.cc][LINE:1269] TraceBack (most recent call last): Task execute failed, device_id=0, stream_id=0, task_id=3, flip_num=0, task_type=86.[FUNC:GetError][FILE:stream.cc][LINE:1082] Failed to synchronize TaskTimeoutSetTask, retCode=0x7150059.[FUNC:SetTimeoutConfig][FILE:runtime.cc][LINE:4977] rtSetOpExecuteTimeOut execute failed, reason=[task timeout][FUNC:FuncErrorReason][FILE:error_message_manage.cc][LINE:53] set op execute timeout failed, runtime result = 107020[FUNC:ReportCallError][FILE:log_inner.cpp][LINE:161] [ERROR] 2024-07-31-09:34:15 (PID:12328, Device:0, RankID:-1) ERR99999 UNKNOWN application exception ``` ## 软件版本: - CANN 版本 8.0.T15: ```bash $ cat ascend_toolkit_install.info package_name=Ascend-cann-toolkit version=8.0.T15 innerversion=V100R001C18B604 compatible_version=[V100R001C15,V100R001C18],[V100R001C30],[V100R001C13],[V100R003C11],[V100R001C29],[V100R001C10] arch=aarch64 os=linux path=/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux ``` - Pytorch版本：2.1.0 - Python 版本：Python 3.10.14 - 操作系统版本：Huawei Cloud EulerOS 2.0.2303.1 ## 日志信息 其他补充信息： - `npu-smi info`:  - `log/debug/plog/plog-12328_20240731093415374.log` <details> ```txt [ERROR] RUNTIME(12328,python):2024-07-31-09:34:15.288.219 [stars_engine.cc:1312]12328 ProcLogicCqReport:[INIT][DEFAULT]Task run failed, device_id=0, stream_id=0, task_id=3, sqe_type=1(aicpu), errType=0x4(task timeout), sqSwStatus=0 [ERROR] RUNTIME(12328,python):2024-07-31-09:34:15.289.562 [device_error_proc.cc:1269]12328 ProcessStarsAicpuErrorInfo:[INIT][DEFAULT]report error module_type=0, module_name=E39999 [ERROR] RUNTIME(12328,python):2024-07-31-09:34:15.289.573 [device_error_proc.cc:1269]12328 ProcessStarsAicpuErrorInfo:[INIT][DEFAULT]The error from device(chipId:7, dieId:0), serial number is 27, an exception occurred during AICPU execution, stream_id:0, task_id:3, errcode:135175, msg:aicpu execute failed.. [ERROR] RUNTIME(12328,python):2024-07-31-09:34:15.289.743 [task_info.cc:313]12328 DoCompleteSuccess:[INIT][DEFAULT]device_id=0, retCode=0x105, [task timeout]. [ERROR] RUNTIME(12328,python):2024-07-31-09:34:15.289.756 [task_info.cc:286]12328 PrintErrorInfoCommon:[INIT][DEFAULT]Task execute failed, device_id=0, stream_id=0, task_id=3, flip_num=0, task_type=86. [ERROR] RUNTIME(12328,python):2024-07-31-09:34:15.289.842 [stream.cc:1079]12328 GetError:[INIT][DEFAULT]Stream Synchronize failed, stream_id=0, retCode=0x105, [task timeout]. [ERROR] RUNTIME(12328,python):2024-07-31-09:34:15.289.850 [stream.cc:1082]12328 GetError:[INIT][DEFAULT]report error module_type=7, module_name=EE9999 [ERROR] RUNTIME(12328,python):2024-07-31-09:34:15.289.856 [stream.cc:1082]12328 GetError:[INIT][DEFAULT]Task execute failed, device_id=0, stream_id=0, task_id=3, flip_num=0, task_type=86. [ERROR] RUNTIME(12328,python):2024-07-31-09:34:15.289.894 [runtime.cc:4977]12328 SetTimeoutConfig:[INIT][DEFAULT]report error module_type=0, module_name=EE9999 [ERROR] RUNTIME(12328,python):2024-07-31-09:34:15.289.900 [runtime.cc:4977]12328 SetTimeoutConfig:[INIT][DEFAULT]Failed to synchronize TaskTimeoutSetTask, retCode=0x7150059. [ERROR] RUNTIME(12328,python):2024-07-31-09:34:15.289.935 [logger.cc:1499]12328 SetOpExecuteTimeOut:[INIT][DEFAULT]Set op execute timeout failed, timeout=547. [ERROR] RUNTIME(12328,python):2024-07-31-09:34:15.289.993 [api_c.cc:3130]12328 rtSetOpExecuteTimeOut:[INIT][DEFAULT]ErrCode=107020, desc=[task timeout], InnerCode=0x7150059 [ERROR] RUNTIME(12328,python):2024-07-31-09:34:15.290.000 [error_message_manage.cc:53]12328 FuncErrorReason:[INIT][DEFAULT]report error module_type=3, module_name=EE8888 [ERROR] RUNTIME(12328,python):2024-07-31-09:34:15.290.012 [error_message_manage.cc:53]12328 FuncErrorReason:[INIT][DEFAULT]rtSetOpExecuteTimeOut execute failed, reason=[task timeout] [ERROR] ASCENDCL(12328,python):2024-07-31-09:34:15.290.077 [event.cpp:261]12328 aclrtSetOpExecuteTimeOut: [INIT][DEFAULT]set op execute timeout failed, runtime result = 107020 ``` </details> - `log/run/plog/plog-12328_20240731093348072.log` <details> ```txt [INFO] PROFILING(12328,python):2024-07-31-09:33:47.897.041 [prof_atls_plugin.cpp:83] >>> (tid:12328) RegisterProfileCallback, callback type is 7 [INFO] PROFILING(12328,python):2024-07-31-09:33:47.897.073 [prof_atls_plugin.cpp:83] >>> (tid:12328) RegisterProfileCallback, callback type is 8 [INFO] ATRACE(12328,python):2024-07-31-09:33:47.919.880 [trace_attr.c:187](tid:12328) attr init success, timeout=0. [INFO] ATRACE(12328,python):2024-07-31-09:33:47.919.904 [trace_recorder.c:121](tid:12328) use root path: /root/ascend [INFO] RUNTIME(12328,python):2024-07-31-09:33:48.202.281 [runtime.cc:5211] 12328 GetVisibleDevices: real deviceCnt:1 userDeviceCnt:1 isSetVisibleDev:1 ASCEND_RT_VISIBLE_DEVICES:0 [INFO] PROFILING(12328,python):2024-07-31-09:33:48.205.198 [prof_atls_plugin.cpp:160] >>> (tid:12328) Module[7] register callback of ctrl handle. [INFO] PROFILING(12328,python):2024-07-31-09:33:48.642.524 [prof_atls_plugin.cpp:160] >>> (tid:12328) Module[61] register callback of ctrl handle. [INFO] IDEDD(12328,python):2024-07-31-09:33:48.694.841 [adx_dump_record.cpp:221][tid:12521]>>> start dump thread, remote dump record temp path : /root/. [INFO] IDEDD(12328,python):2024-07-31-09:33:48.694.897 [adx_server_manager.cpp:209][tid:12522]>>> Run Server(0) Process [INFO] IDEDD(12328,python):2024-07-31-09:33:48.694.956 [hdc_comm_opt.cpp:59][tid:12522]>>> open device[0] server[13] [INFO] PROFILING(12328,python):2024-07-31-09:33:48.694.977 [prof_atls_plugin.cpp:160] >>> (tid:12328) Module[48] register callback of ctrl handle. [INFO] PROFILING(12328,python):2024-07-31-09:33:48.694.996 [prof_atls_plugin.cpp:160] >>> (tid:12328) Module[45] register callback of ctrl handle. [INFO] IDEDD(12328,python):2024-07-31-09:33:48.695.101 [hdc_api.cpp:119][tid:12522]>>> logDevId 0 create HDC server successfully [INFO] GE(12328,python):2024-07-31-09:33:48.881.986 [op_tiling_manager.cc:102][EVENT]12328 ~FuncPerfScope:[GEPERFTRACE] The time cost of OpTilingManager::LoadSo is [186976] micro second. [INFO] PROFILING(12328,python):2024-07-31-09:33:48.897.469 [prof_atls_plugin.cpp:160] >>> (tid:12328) Module[6] register callback of ctrl handle. [INFO] TDT(12328,python):2024-07-31-09:33:49.552.031 [client_manager.cpp:397][IsHostEnvironment][tid:12328] [TsdClient] logicDeviceId is [0], hostaicpunum[0] [INFO] TDT(12328,python):2024-07-31-09:33:49.552.050 [client_manager.cpp:426][GetClientRunMode][tid:12328] runningMode:0 [INFO] TDT(12328,python):2024-07-31-09:33:49.552.054 [client_manager.cpp:104][GetInstance][tid:12328] curmode:1 [INFO] TDT(12328,python):2024-07-31-09:33:49.552.154 [process_mode_manager.cpp:127][OpenProcess][tid:12328] [ProcessModeManager] enter into open process deviceId[0] rankSize[0] [INFO] TDT(12328,python):2024-07-31-09:33:49.552.675 [process_mode_manager.cpp:418][InitTsdClient][tid:12328] [TsdClient] deviceId[0] begin to init hdc client [INFO] TDT(12328,python):2024-07-31-09:33:49.552.765 [version_verify.cpp:34][SetVersionInfo][tid:12328] VersionVerify: send client version to server [INFO] TDT(12328,python):2024-07-31-09:33:49.552.786 [version_verify.cpp:50][SetVersionInfo][tid:12328] send feature_info:{msg_type:35, features:{check before send aicpu package,}} [INFO] TDT(12328,python):2024-07-31-09:33:49.552.794 [version_verify.cpp:50][SetVersionInfo][tid:12328] send feature_info:{msg_type:37, features:{check before send open qs message,}} [INFO] TDT(12328,python):2024-07-31-09:33:49.553.070 [version_verify.cpp:66][PeerVersionCheck][tid:12328] VersionVerify: Check client version info, server[1230], client[1230] [INFO] TDT(12328,python):2024-07-31-09:33:49.553.079 [version_verify.cpp:87][ParseVersionInfo][tid:12328] VersionVerify: pass client version info success [INFO] TDT(12328,python):2024-07-31-09:33:49.553.083 [hdc_client.cpp:277][CheckHdcConnection][tid:12328] Service[2] create hdc success [INFO] TDT(12328,python):2024-07-31-09:33:49.553.093 [version_verify.cpp:120][SpecialFeatureCheck][tid:12328] VersionVerify: new type[35], supported [INFO] TDT(12328,python):2024-07-31-09:33:49.553.133 [process_mode_manager.cpp:821][GetDeviceCheckCode][tid:12328] [TsdClient][deviceId=0] [sessionId=1] wait package info respond [INFO] TDT(12328,python):2024-07-31-09:33:49.614.632 [process_mode_manager.cpp:1916][SendExtendPackage][tid:12328] device not support extend pkg skip send [INFO] TDT(12328,python):2024-07-31-09:33:49.614.666 [process_mode_manager.cpp:418][InitTsdClient][tid:12328] [TsdClient] deviceId[0] begin to init hdc client [INFO] TDT(12328,python):2024-07-31-09:33:49.614.804 [version_verify.cpp:34][SetVersionInfo][tid:12328] VersionVerify: send client version to server [INFO] TDT(12328,python):2024-07-31-09:33:49.614.818 [version_verify.cpp:50][SetVersionInfo][tid:12328] send feature_info:{msg_type:35, features:{check before send aicpu package,}} [INFO] TDT(12328,python):2024-07-31-09:33:49.614.826 [version_verify.cpp:50][SetVersionInfo][tid:12328] send feature_info:{msg_type:37, features:{check before send open qs message,}} [INFO] TDT(12328,python):2024-07-31-09:33:49.629.791 [version_verify.cpp:66][PeerVersionCheck][tid:12328] VersionVerify: Check client version info, server[1230], client[1230] [INFO] TDT(12328,python):2024-07-31-09:33:49.629.801 [version_verify.cpp:87][ParseVersionInfo][tid:12328] VersionVerify: pass client version info success [INFO] TDT(12328,python):2024-07-31-09:33:49.629.804 [hdc_client.cpp:277][CheckHdcConnection][tid:12328] Service[2] create hdc success [INFO] TDT(12328,python):2024-07-31-09:33:49.629.814 [process_mode_manager.cpp:465][ConstructOpenMsg][tid:12328] [TsdClient] tsd get process sign successfully, procpid[3811976] signSize[48] [INFO] TDT(12328,python):2024-07-31-09:33:49.629.823 [version_verify.cpp:112][SpecialFeatureCheck][tid:12328] VersionVerify: previous type[6], supported [INFO] TDT(12328,python):2024-07-31-09:33:49.629.840 [process_mode_manager.cpp:144][OpenProcess][tid:12328] [ProcessModeManager] deviceId[0] sessionId[1] rankSize[0], wait sub process start respond [INFO] TDT(12328,python):2024-07-31-09:33:52.631.185 [stub_process_mode_nowin.cpp:63][ProcessQueueForMdc][tid:12328] [TsdClient] it is unnecessary of current mode[0] chiptype[5] to grant queue auth to aicpusd [INFO] TDT(12328,python):2024-07-31-09:33:52.631.205 [stub_process_mode_nowin.cpp:101][OpenInHost][tid:12328] enter into OpenInHost deviceid[0] [INFO] TDT(12328,python):2024-07-31-09:33:52.631.235 [client_manager.cpp:397][IsHostEnvironment][tid:12328] [TsdClient] logicDeviceId is [0], hostaicpunum[0] [INFO] TDT(12328,python):2024-07-31-09:33:52.631.241 [stub_process_mode_nowin.cpp:105][OpenInHost][tid:12328] host cpu not support [INFO] TDT(12328,python):2024-07-31-09:33:52.631.244 [process_mode_manager.cpp:178][OpenProcess][tid:12328] [TsdClient][deviceId=0] [sessionId=1] start hccp and computer process success [INFO] RUNTIME(12328,python):2024-07-31-09:33:52.634.900 [device.cc:343] 12328 Init: isAddrFlat:0 [INFO] TDT(12328,python):2024-07-31-09:33:52.635.761 [tsd_client.cpp:182][TsdCapabilityGet][tid:12328] TsdCapabilityGet Begin. [INFO] TDT(12328,python):2024-07-31-09:33:52.635.771 [process_mode_manager.cpp:1128][CapabilityGet][tid:12328] [ProcessModeManager] enter into CapabilityGet process deviceId[0] type[0] [INFO] TDT(12328,python):2024-07-31-09:33:52.635.782 [version_verify.cpp:112][SpecialFeatureCheck][tid:12328] VersionVerify: previous type[38], supported [INFO] TDT(12328,python):2024-07-31-09:33:52.635.814 [process_mode_manager.cpp:1151][CapabilityGet][tid:12328] [TsdClient][deviceId=0] [sessionId=1] [type=0]send capability success [INFO] TDT(12328,python):2024-07-31-09:33:52.635.953 [process_mode_manager.cpp:691][PidQosMsgProc][tid:12328] [TsdClient] PidQosMsgProc recvMsg realDeviceId[0] msgType[39] localDevId[0] rspCode[0],pidqos[1] [INFO] TDT(12328,python):2024-07-31-09:33:52.635.960 [process_mode_manager.cpp:1156][CapabilityGet][tid:12328] [TsdClient][logicDeviceId_=0][type=0][pidQos=1][ret=0]recv capability respond finish [INFO] RUNTIME(12328,python):2024-07-31-09:33:52.650.576 [npu_driver.cc:5571] 12525 GetDeviceStatus: GetDeviceStatus status=1. [INFO] ATRACE(12328,python):2024-07-31-09:33:52.651.356 [tracer_mgr_operate.c:59](tid:12328) create object RUNTIME_ATRACE_DEV0_TS0 success, exitSave(false). [INFO] TDT(12328,python):2024-07-31-09:33:52.651.369 [client_manager.cpp:164][SetProfilingCallback][tid:12328] [TsdClient] set profiling callback success [INFO] GE(12328,python):2024-07-31-09:33:52.658.772 [ge_api.cc:175][status:INIT]12328 GEInitializeImpl:GEInitialize start [INFO] GE(12328,python):2024-07-31-09:33:52.658.787 [ge_api.cc:189][EVENT]12328 GEInitializeImpl:[GEPERFTRACE] The time cost of GEInitialize::GEAPICheckSupportedGlobalOptions is [7] micro second. [INFO] GE(12328,python):2024-07-31-09:33:52.685.373 [ge_api.cc:206][EVENT]12328 GEInitializeImpl:[GEPERFTRACE] The time cost of GEInitialize::CheckOptionsValid is [52] micro second. [INFO] GE(12328,python):2024-07-31-09:33:52.920.695 [ge_api.cc:221][EVENT]12328 GEInitializeImpl:[GEPERFTRACE] The time cost of GEInitialize::ManagerInitialize is [233964] micro second. [INFO] GE(12328,python):2024-07-31-09:33:52.920.870 [ge_api.cc:236][EVENT]12328 GEInitializeImpl:[GEPERFTRACE] The time cost of GEInitialize::InitProfiling is [149] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.002.846 [ge_api.cc:246][EVENT]12328 GEInitializeImpl:[GEPERFTRACE] The time cost of GEInitialize::InitPreparation is [81872] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.002.865 [gelib.cc:91][EVENT]12328 Initialize:[GEPERFTRACE] GE Init Start [INFO] GE(12328,python):2024-07-31-09:33:53.191.801 [gelib.cc:157][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of GELib::InitializePrepare is [188928] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.192.357 [gelib.cc:312][EVENT]12328 SystemInitialize:Infer init GELib success, device id :-1 [INFO] GE(12328,python):2024-07-31-09:33:53.192.366 [gelib.cc:184][EVENT]12328 InnerInitialize:[GEPERFTRACE] The time cost of InnerInitialize::SystemInitialize is [14] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.258.766 [process_node_engine_manager.cc:63][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of ProcessNodeEngineManager::Initialize[HOST_CPU] is [2] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.258.790 [process_node_engine_manager.cc:63][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of ProcessNodeEngineManager::Initialize[NPU] is [2] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.258.796 [process_node_engine_manager.cc:63][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of ProcessNodeEngineManager::Initialize[PS] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.258.800 [process_node_engine_manager.cc:63][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of ProcessNodeEngineManager::Initialize[UDF] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.258.808 [gelib.cc:208][EVENT]12328 InnerInitialize:[GEPERFTRACE] The time cost of InnerInitialize::ProcessNodeEngine is [66016] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.260.441 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetDNNEngineObjs] in [libengine.so] is [124] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.260.452 [dnnengine_manager.cc:128][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of DNNEngineManager::Initialize[AIcoreEngine] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.260.460 [dnnengine_manager.cc:128][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of DNNEngineManager::Initialize[DNN_HCCL] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.260.465 [dnnengine_manager.cc:128][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of DNNEngineManager::Initialize[DNN_VM_AICPU] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.260.469 [dnnengine_manager.cc:128][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of DNNEngineManager::Initialize[DNN_VM_AICPU_ASCEND] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.260.473 [dnnengine_manager.cc:128][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of DNNEngineManager::Initialize[DNN_VM_AICPU_ASCEND_FFTS_PLUS] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.260.477 [dnnengine_manager.cc:128][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of DNNEngineManager::Initialize[DNN_VM_AICPU_FFTS_PLUS] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.260.481 [dnnengine_manager.cc:128][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of DNNEngineManager::Initialize[DNN_VM_DVPP] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.260.485 [dnnengine_manager.cc:128][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of DNNEngineManager::Initialize[DNN_VM_GE_LOCAL] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.260.488 [dnnengine_manager.cc:128][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of DNNEngineManager::Initialize[DNN_VM_HOST_CPU] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.260.492 [dnnengine_manager.cc:128][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of DNNEngineManager::Initialize[DNN_VM_RTS] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.260.495 [dnnengine_manager.cc:128][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of DNNEngineManager::Initialize[DNN_VM_RTS_FFTS_PLUS] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.260.499 [dnnengine_manager.cc:128][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of DNNEngineManager::Initialize[DSAEngine] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.260.502 [dnnengine_manager.cc:128][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of DNNEngineManager::Initialize[VectorEngine] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.260.505 [dnnengine_manager.cc:128][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of DNNEngineManager::Initialize[ffts_plus] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.261.248 [gelib.cc:219][EVENT]12328 InnerInitialize:[GEPERFTRACE] The time cost of InnerInitialize::EngineInitialize is [2433] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.263.288 [op_tiling_manager.cc:102][EVENT]12328 ~FuncPerfScope:[GEPERFTRACE] The time cost of OpTilingManager::LoadSo is [1812] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.587.199 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/libfe.so] is [323841] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.590.065 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/libge_local_engine.so] is [2776] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.606.122 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/librts_engine.so] is [16013] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.630.869 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/libaicpu_ascend_engine.so] is [24700] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.634.981 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/libhost_cpu_engine.so] is [4068] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.653.225 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/libaicpu_tf_engine.so] is [18200] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.686.425 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/libffts.so] is [33154] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.691.062 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/libdvpp_engine.so] is [4587] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.730.484 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/libhcom_graph_adaptor.so] is [39377] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.730.514 [ops_kernel_manager.cc:78][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of OpsKernelManager::LoadPluginManagerSo is [467213] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.920.179 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [Initialize] in [libaicpu_ascend_engine.so] is [189647] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.920.699 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [Initialize] in [libaicpu_tf_engine.so] is [501] micro second. [INFO] GE(12328,python):2024-07-31-09:33:53.920.735 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [Initialize] in [libdvpp_engine.so] is [26] micro second. [INFO] ATRACE(12328,python):2024-07-31-09:33:53.920.832 [tracer_mgr_operate.c:59](tid:12328) create object FE_Global_Trace success, exitSave(false). [INFO] ATRACE(12328,python):2024-07-31-09:33:53.920.893 [tracer_mgr_operate.c:59](tid:12328) create object FE_Statistics_Trace success, exitSave(false). [INFO] TUNE(12328,python):2024-07-31-09:33:53.926.522 [cann_kb_pyfunc_mgr.cpp:72][CANNKB][Tid:12328]"CannKbPyfuncMgr: Enter PyObjectInit, reference_ is 0!" [INFO] TUNE(12328,python):2024-07-31-09:33:53.926.545 [handle_manager.cpp:115][CANNKB][Tid:12328]"Start to run init functions to load dynamic python lib!" [INFO] TUNE(12328,python):2024-07-31-09:33:53.926.608 [handle_manager.cpp:407][CANNKB][Tid:12328]"Init functions of loading dynamic python lib end!" [INFO] TUNE(12328,python):2024-07-31-09:33:53.926.613 [cann_kb_pyfunc_mgr.cpp:24][CANNKB][Tid:12328]"CANN_KB_Py has already been initialized." [INFO] TUNE(12328,python):2024-07-31-09:34:00.442.316 [cann_kb_pyfunc_mgr.cpp:117][CANNKB][Tid:12328]"CannKbPyfuncMgr: Run PyObjectInit successfully!" [INFO] GE(12328,python):2024-07-31-09:34:03.730.090 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [Initialize] in [libfe.so] is [9809329] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.937.925 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [Initialize] in [libffts.so] is [207778] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.938.001 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [Initialize] in [libge_local_engine.so] is [23] micro second. [INFO] HCCL(12328,python):2024-07-31-09:34:03.938.041 [plugin_manager.cc:42][12328]hcom running normal mode. [INFO] GE(12328,python):2024-07-31-09:34:03.938.299 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [Initialize] in [libhcom_graph_adaptor.so] is [291] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.938.566 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [Initialize] in [libhost_cpu_engine.so] is [259] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.938.640 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [Initialize] in [librts_engine.so] is [67] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.938.706 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetOpsKernelInfoStores] in [libaicpu_ascend_engine.so] is [54] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.938.740 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetOpsKernelInfoStores] in [libaicpu_tf_engine.so] is [28] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.938.771 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetOpsKernelInfoStores] in [libdvpp_engine.so] is [26] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.938.817 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetOpsKernelInfoStores] in [libfe.so] is [41] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.938.824 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetOpsKernelInfoStores] in [libffts.so] is [2] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.938.839 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetOpsKernelInfoStores] in [libge_local_engine.so] is [11] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.938.881 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetOpsKernelInfoStores] in [libhcom_graph_adaptor.so] is [22] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.938.893 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetOpsKernelInfoStores] in [libhost_cpu_engine.so] is [7] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.938.913 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetOpsKernelInfoStores] in [librts_engine.so] is [16] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.938.941 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetGraphOptimizerObjs] in [libaicpu_ascend_engine.so] is [22] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.938.955 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetGraphOptimizerObjs] in [libaicpu_tf_engine.so] is [11] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.938.974 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetGraphOptimizerObjs] in [libdvpp_engine.so] is [14] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.022 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetGraphOptimizerObjs] in [libfe.so] is [45] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.038 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetGraphOptimizerObjs] in [libffts.so] is [10] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.055 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetGraphOptimizerObjs] in [libge_local_engine.so] is [12] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.084 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetGraphOptimizerObjs] in [libhcom_graph_adaptor.so] is [25] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.094 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetGraphOptimizerObjs] in [libhost_cpu_engine.so] is [6] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.105 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetGraphOptimizerObjs] in [librts_engine.so] is [7] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.119 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetCompositeEngines] in [libaicpu_ascend_engine.so] is [9] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.124 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetCompositeEngines] in [libaicpu_tf_engine.so] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.129 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetCompositeEngines] in [libdvpp_engine.so] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.135 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetCompositeEngines] in [libfe.so] is [3] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.315 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetCompositeEngines] in [libffts.so] is [175] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.323 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetCompositeEngines] in [libge_local_engine.so] is [2] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.349 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetCompositeEngines] in [libhcom_graph_adaptor.so] is [9] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.354 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetCompositeEngines] in [libhost_cpu_engine.so] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.358 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetCompositeEngines] in [librts_engine.so] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.366 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetFFTSPlusSwitch] in [libaicpu_ascend_engine.so] is [3] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.370 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetFFTSPlusSwitch] in [libaicpu_tf_engine.so] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.374 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetFFTSPlusSwitch] in [libdvpp_engine.so] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.380 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetFFTSPlusSwitch] in [libfe.so] is [2] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.438 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetFFTSPlusSwitch] in [libffts.so] is [55] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.444 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetFFTSPlusSwitch] in [libge_local_engine.so] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.452 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetFFTSPlusSwitch] in [libhcom_graph_adaptor.so] is [3] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.456 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetFFTSPlusSwitch] in [libhost_cpu_engine.so] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.460 [dnnengine_manager.cc:41][EVENT]12328 ~InvokeFuncPerfRecorder:[GEPERFTRACE] The time cost of InvokeAll [GetFFTSPlusSwitch] in [librts_engine.so] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.470 [ops_kernel_manager.cc:153][EVENT]12328 InitOpKernelInfoStores:[GEPERFTRACE] The time cost of InitOpKernelInfoStores::Initialize[AIcoreEngine] is [2] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.939.654 [ops_kernel_manager.cc:153][EVENT]12328 InitOpKernelInfoStores:[GEPERFTRACE] The time cost of InitOpKernelInfoStores::Initialize[DNN_VM_GE_LOCAL_OP_STORE] is [179] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.963.392 [ops_kernel_manager.cc:153][EVENT]12328 InitOpKernelInfoStores:[GEPERFTRACE] The time cost of InitOpKernelInfoStores::Initialize[DNN_VM_HOST_CPU_OP_STORE] is [23726] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.963.532 [ops_kernel_manager.cc:153][EVENT]12328 InitOpKernelInfoStores:[GEPERFTRACE] The time cost of InitOpKernelInfoStores::Initialize[DNN_VM_RTS_FFTS_PLUS_OP_STORE] is [115] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.963.634 [ops_kernel_manager.cc:153][EVENT]12328 InitOpKernelInfoStores:[GEPERFTRACE] The time cost of InitOpKernelInfoStores::Initialize[DNN_VM_RTS_OP_STORE] is [94] micro second. [INFO] GE(12328,python):2024-07-31-09:34:03.963.641 [ops_kernel_manager.cc:153][EVENT]12328 InitOpKernelInfoStores:[GEPERFTRACE] The time cost of InitOpKernelInfoStores::Initialize[DSAEngine] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.029.205 [ops_kernel_manager.cc:153][EVENT]12328 InitOpKernelInfoStores:[GEPERFTRACE] The time cost of InitOpKernelInfoStores::Initialize[aicpu_ascend_kernel] is [65553] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.285.971 [ops_kernel_manager.cc:153][EVENT]12328 InitOpKernelInfoStores:[GEPERFTRACE] The time cost of InitOpKernelInfoStores::Initialize[aicpu_tf_kernel] is [256733] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.312.571 [ops_kernel_manager.cc:153][EVENT]12328 InitOpKernelInfoStores:[GEPERFTRACE] The time cost of InitOpKernelInfoStores::Initialize[dvpp_ops_kernel] is [26573] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.312.586 [ops_kernel_manager.cc:153][EVENT]12328 InitOpKernelInfoStores:[GEPERFTRACE] The time cost of InitOpKernelInfoStores::Initialize[ops_kernel_info_hccl] is [3] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.312.593 [graph_builder.cc:102][EVENT]12328 ~FuncPerfScope:[GEPERFTRACE] The time cost of OpsKernelManager::InitOpKernelInfoStores is [373127] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.318.813 [ops_kernel_manager.cc:174][EVENT]12328 InitOpsKernelInfo:[GEPERFTRACE] The time cost of InitOpsKernelInfo::GetAllOpsKernelInfo[AIcoreEngine] is [6212] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.320.411 [ops_kernel_manager.cc:174][EVENT]12328 InitOpsKernelInfo:[GEPERFTRACE] The time cost of InitOpsKernelInfo::GetAllOpsKernelInfo[DNN_VM_GE_LOCAL_OP_STORE] is [59] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.320.626 [ops_kernel_manager.cc:174][EVENT]12328 InitOpsKernelInfo:[GEPERFTRACE] The time cost of InitOpsKernelInfo::GetAllOpsKernelInfo[DNN_VM_HOST_CPU_OP_STORE] is [95] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.320.759 [ops_kernel_manager.cc:174][EVENT]12328 InitOpsKernelInfo:[GEPERFTRACE] The time cost of InitOpsKernelInfo::GetAllOpsKernelInfo[DNN_VM_RTS_FFTS_PLUS_OP_STORE] is [12] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.320.810 [ops_kernel_manager.cc:174][EVENT]12328 InitOpsKernelInfo:[GEPERFTRACE] The time cost of InitOpsKernelInfo::GetAllOpsKernelInfo[DNN_VM_RTS_OP_STORE] is [26] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.320.895 [ops_kernel_manager.cc:174][EVENT]12328 InitOpsKernelInfo:[GEPERFTRACE] The time cost of InitOpsKernelInfo::GetAllOpsKernelInfo[DSAEngine] is [33] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.321.138 [ops_kernel_manager.cc:174][EVENT]12328 InitOpsKernelInfo:[GEPERFTRACE] The time cost of InitOpsKernelInfo::GetAllOpsKernelInfo[aicpu_ascend_kernel] is [224] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.322.000 [ops_kernel_manager.cc:174][EVENT]12328 InitOpsKernelInfo:[GEPERFTRACE] The time cost of InitOpsKernelInfo::GetAllOpsKernelInfo[aicpu_tf_kernel] is [524] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.323.018 [ops_kernel_manager.cc:174][EVENT]12328 InitOpsKernelInfo:[GEPERFTRACE] The time cost of InitOpsKernelInfo::GetAllOpsKernelInfo[dvpp_ops_kernel] is [23] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.323.173 [ops_kernel_manager.cc:174][EVENT]12328 InitOpsKernelInfo:[GEPERFTRACE] The time cost of InitOpsKernelInfo::GetAllOpsKernelInfo[ops_kernel_info_hccl] is [109] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.324.231 [graph_builder.cc:102][EVENT]12328 ~FuncPerfScope:[GEPERFTRACE] The time cost of OpsKernelManager::InitOpsKernelInfo is [11631] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.553.111 [ops_kernel_manager.cc:245][EVENT]12328 InitGraphOptimizers:[GEPERFTRACE] The time cost of InitGraphOptimizers::Initialize[AIcoreEngine] is [228841] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.554.749 [ops_kernel_manager.cc:245][EVENT]12328 InitGraphOptimizers:[GEPERFTRACE] The time cost of InitGraphOptimizers::Initialize[DNN_VM_HOST_CPU_OPTIMIZER] is [1610] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.554.784 [ops_kernel_manager.cc:245][EVENT]12328 InitGraphOptimizers:[GEPERFTRACE] The time cost of InitGraphOptimizers::Initialize[DNN_VM_RTS_FFTS_PLUS_GRAPH_OPTIMIZER_STORE] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.554.814 [ops_kernel_manager.cc:245][EVENT]12328 InitGraphOptimizers:[GEPERFTRACE] The time cost of InitGraphOptimizers::Initialize[DNN_VM_RTS_GRAPH_OPTIMIZER_STORE] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.554.821 [ops_kernel_manager.cc:245][EVENT]12328 InitGraphOptimizers:[GEPERFTRACE] The time cost of InitGraphOptimizers::Initialize[DSAEngine] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.556.333 [ops_kernel_manager.cc:245][EVENT]12328 InitGraphOptimizers:[GEPERFTRACE] The time cost of InitGraphOptimizers::Initialize[aicpu_ascend_optimizer] is [1505] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.559.896 [ops_kernel_manager.cc:245][EVENT]12328 InitGraphOptimizers:[GEPERFTRACE] The time cost of InitGraphOptimizers::Initialize[aicpu_tf_optimizer] is [3550] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.559.969 [ops_kernel_manager.cc:245][EVENT]12328 InitGraphOptimizers:[GEPERFTRACE] The time cost of InitGraphOptimizers::Initialize[dvpp_graph_optimizer] is [25] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.089 [ops_kernel_manager.cc:245][EVENT]12328 InitGraphOptimizers:[GEPERFTRACE] The time cost of InitGraphOptimizers::Initialize[ffts_plus] is [112] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.097 [ops_kernel_manager.cc:245][EVENT]12328 InitGraphOptimizers:[GEPERFTRACE] The time cost of InitGraphOptimizers::Initialize[ge_local_graph_optimizer] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.135 [ops_kernel_manager.cc:245][EVENT]12328 InitGraphOptimizers:[GEPERFTRACE] The time cost of InitGraphOptimizers::Initialize[hccl_alltoallvc_fusion_optimizer] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.188 [ops_kernel_manager.cc:245][EVENT]12328 InitGraphOptimizers:[GEPERFTRACE] The time cost of InitGraphOptimizers::Initialize[hccl_graph_optimizer] is [27] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.194 [graph_builder.cc:102][EVENT]12328 ~FuncPerfScope:[GEPERFTRACE] The time cost of OpsKernelManager::InitGraphOptimizers is [235955] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.201 [ops_kernel_manager.cc:365][EVENT]12328 ClassifyGraphOptimizers:[GEPERFTRACE] The time cost of ClassifyGraphOptimizers::GetAttributes[AIcoreEngine] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.208 [ops_kernel_manager.cc:365][EVENT]12328 ClassifyGraphOptimizers:[GEPERFTRACE] The time cost of ClassifyGraphOptimizers::GetAttributes[DNN_VM_HOST_CPU_OPTIMIZER] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.213 [ops_kernel_manager.cc:365][EVENT]12328 ClassifyGraphOptimizers:[GEPERFTRACE] The time cost of ClassifyGraphOptimizers::GetAttributes[DNN_VM_RTS_FFTS_PLUS_GRAPH_OPTIMIZER_STORE] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.218 [ops_kernel_manager.cc:365][EVENT]12328 ClassifyGraphOptimizers:[GEPERFTRACE] The time cost of ClassifyGraphOptimizers::GetAttributes[DNN_VM_RTS_GRAPH_OPTIMIZER_STORE] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.223 [ops_kernel_manager.cc:365][EVENT]12328 ClassifyGraphOptimizers:[GEPERFTRACE] The time cost of ClassifyGraphOptimizers::GetAttributes[DSAEngine] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.228 [ops_kernel_manager.cc:365][EVENT]12328 ClassifyGraphOptimizers:[GEPERFTRACE] The time cost of ClassifyGraphOptimizers::GetAttributes[aicpu_ascend_optimizer] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.232 [ops_kernel_manager.cc:365][EVENT]12328 ClassifyGraphOptimizers:[GEPERFTRACE] The time cost of ClassifyGraphOptimizers::GetAttributes[aicpu_tf_optimizer] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.237 [ops_kernel_manager.cc:365][EVENT]12328 ClassifyGraphOptimizers:[GEPERFTRACE] The time cost of ClassifyGraphOptimizers::GetAttributes[dvpp_graph_optimizer] is [0] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.241 [ops_kernel_manager.cc:365][EVENT]12328 ClassifyGraphOptimizers:[GEPERFTRACE] The time cost of ClassifyGraphOptimizers::GetAttributes[ffts_plus] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.246 [ops_kernel_manager.cc:365][EVENT]12328 ClassifyGraphOptimizers:[GEPERFTRACE] The time cost of ClassifyGraphOptimizers::GetAttributes[ge_local_graph_optimizer] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.250 [ops_kernel_manager.cc:365][EVENT]12328 ClassifyGraphOptimizers:[GEPERFTRACE] The time cost of ClassifyGraphOptimizers::GetAttributes[hccl_alltoallvc_fusion_optimizer] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.254 [ops_kernel_manager.cc:365][EVENT]12328 ClassifyGraphOptimizers:[GEPERFTRACE] The time cost of ClassifyGraphOptimizers::GetAttributes[hccl_graph_optimizer] is [1] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.560.258 [graph_builder.cc:102][EVENT]12328 ~FuncPerfScope:[GEPERFTRACE] The time cost of OpsKernelManager::ClassifyGraphOptimizers is [58] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.561.775 [proto_util.cc:102][EVENT]12328 ~FuncPerfScope:[GEPERFTRACE] The time cost of ReadProtoFromText::/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/optimizer_priority.pbtxt is [999] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.561.827 [graph_builder.cc:102][EVENT]12328 ~FuncPerfScope:[GEPERFTRACE] The time cost of OpsKernelManager::InitGraphOptimizerPriority is [1565] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.561.929 [gelib.cc:231][EVENT]12328 InnerInitialize:[GEPERFTRACE] The time cost of InnerInitialize::OpsManagerInitialize is [11300665] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.564.730 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/libge_local_opskernel_builder.so] is [2665] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.566.913 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/libhost_cpu_opskernel_builder.so] is [2136] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.566.979 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/librts_engine.so] is [26] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.567.015 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/libaicpu_ascend_engine.so] is [10] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.567.053 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/libaicpu_tf_engine.so] is [14] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.567.087 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/libdvpp_engine.so] is [9] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.578.024 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/libhcom_opskernel_builder.so] is [10910] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.581.672 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/libhvd_opskernel_builder.so] is [3587] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.584.532 [plugin_manager.cc:567][EVENT]12328 LoadSoWithFlags:[GEPERFTRACE] The time cost of PluginManager::Dlopen[/usr/local/Ascend/ascend-toolkit/8.0.T15/aarch64-linux/lib64/plugin/opskernel/libhcom_gradtune_opskernel_builder.so] is [2817] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.586.183 [gelib.cc:243][EVENT]12328 InnerInitialize:[GEPERFTRACE] The time cost of InnerInitialize::OpsKernelBuilderManager is [24203] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.586.202 [gelib.cc:254][EVENT]12328 InnerInitialize:[GEPERFTRACE] The time cost of InnerInitialize::HostCpuEngineInitialize is [10] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.586.247 [gelib.cc:265][EVENT]12328 InnerInitialize:[GEPERFTRACE] The time cost of InnerInitialize::AnalyzerInitialize is [40] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.586.261 [gelib.cc:168][EVENT]12328 Initialize:[GEPERFTRACE] The time cost of GELib::Initialize is [11394447] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.586.302 [ge_api.cc:252][EVENT]12328 GEInitializeImpl:[GEPERFTRACE] The time cost of GEInitialize::GELibInitialize is [11583438] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.586.324 [ge_api.cc:268][EVENT]12328 GEInitializeImpl:[GEPERFTRACE] The time cost of InnerInitialize::SessionManagerInitialize is [10] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.586.331 [ge_api.cc:285][EVENT]12328 GEInitializeImpl:[GEPERFTRACE] The time cost of GeExecutor::Initialize is [2] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.586.363 [ge_api.cc:288][EVENT]12328 GEInitializeImpl:[GEPERFTRACE] The time cost of InitializeExecutionRuntime is [28] micro second. [INFO] GE(12328,python):2024-07-31-09:34:04.586.367 [ge_api.cc:294][status:STOP]12328 GEInitializeImpl:GEInitialize finished [INFO] GE(12328,python):2024-07-31-09:34:04.586.379 [ge_api.cc:295][EVENT]12328 GEInitializeImpl:[GEPERFTRACE] The time cost of GEInitialize::All is [11927610] micro second. [INFO] RUNTIME(12328,python):2024-07-31-09:34:15.289.716 [runtime.cc:5551] 12328 SetWatchDogDevStatus: There is errInfo of devId=0, tsId=0 [INFO] IDEDD(12328,python):2024-07-31-09:34:18.093.784 [adx_server_manager.cpp:49][tid:12328]>>> start to deconstruct adx server manager [INFO] IDEDD(12328,python):2024-07-31-09:34:18.396.287 [adx_server_manager.cpp:241][tid:12522]>>> server manager stop [INFO] IDEDD(12328,python):2024-07-31-09:34:18.672.674 [adx_server_manager.cpp:49][tid:12328]>>> start to deconstruct adx server manager [INFO] RUNTIME(12328,python):2024-07-31-09:34:18.672.921 [runtime.cc:1873] 12328 ~Runtime: deconstruct runtime [INFO] RUNTIME(12328,python):2024-07-31-09:34:18.672.928 [runtime.cc:1880] 12328 ~Runtime: wait monitor success, use=0. [INFO] ATRACE(12328,python):2024-07-31-09:34:18.674.145 [tracer_mgr_operate.c:137](tid:12328) destory object RUNTIME_ATRACE_DEV0_TS0, exitSave(false). ``` - ACLHelloWorld 运行结果 <details> ```bash (base) [root@devserver-bms-c4907478-tmp0630 samples-master]# cd inference/ACLHelloWorld/scripts/ (base) [root@devserver-bms-c4907478-tmp0630 scripts]# bash sample_run.sh [INFO] The sample starts to run [INFO] Acl Init Success [INFO] Acl Set Device Success,Current DeviceID:0 [INFO] Acl Create Context Success [INFO] Acl Create Stream Success [INFO] Acl Destroy Stream Success [INFO] Acl Destroy Context success [INFO] Acl Reset Device Success [INFO] Acl Finalize Success [INFO] The program runs successfully ``` </details>
评论 (
2
)
登录
后才可以发表评论
状态
DONE
TODO
Analysing
ACCEPTED
WIP
Feedback
TEST
DONE
REJECTED
负责人
未设置
标签
未设置
项目
未立项任务
未立项任务
里程碑
未关联里程碑
未关联里程碑
Pull Requests
未关联
未关联
关联的 Pull Requests 被合并后可能会关闭此 issue
分支
未关联
分支 (79)
标签 (186)
master
v2.8.0
v2.1.0
v2.6.0
v2.7.1
v2.5.1
v2.6.0-7.1.0
v2.5.1-7.1.0
v2.1.0-7.1.0
revert-merge-23967-master
revert-merge-23966-v2.8.0
revert-merge-23965-v2.7.1
revert-merge-23964-v2.6.0
revert-merge-23962-v2.5.1
revert-merge-23789-v2.1.0
v2.1.0-7.0.0
v2.4.0-7.0.0
v2.4.0
v2.3.1
v2.3.1-7.0.0
v2.5.1-7.0.0
v2.4.0-6.0.0
v2.3.1-6.0.0
v2.1.0-6.0.0
v2.1.0-6.0.rc3
v2.3.1-6.0.rc3
v2.4.0-6.0.rc3
v2.2.0
v1.11.0-6.0.rc1
v2.1.0-6.0.rc1
v2.2.0-6.0.rc1
v1.11.0-6.0.rc2
v2.1.0-6.0.rc2
v2.2.0-6.0.rc2
v2.3.1-6.0.rc2
v1.11.0
v2.1.0-5.0.0
v2.0.1-5.0.0
v1.11.0-5.0.0
v2.0.1
v2.1.0-5.0.rc3
v1.11.0-5.0.rc3
v2.0.1-5.0.rc3
v1.11.0-5.0.rc3.3
v1.8.1
v1.11.0-x1
v1.8.1-5.0.rc3
v1.11.0-5.0.rc2.2
v1.11.0-zj
v1.11.0-5.0.rc2.1
v2.0.1-5.0.rc2
v1.11.0-5.0.rc2
v1.8.1-5.0.rc2
v2.0.0-5.0.rc2
v1.8.1-5.0.rc1
v1.11.0-5.0.rc1
v1.11.0-yd
v1.11.0-xf
v1.11.0-infer
v1.11.0-bigkernel
v1.11.0-host_api
v1.8.1-3.0.0
v1.11.0-5.0.rc2.t100
v1.8.1-5.0.rc2.t100
v1.8.1-3.0.0-dev
v1.11.0-3.0.0
v2.0-dev
v1.8.1-3.0.rc3
v1.5.0-3.0.0
v1.5.0
v1.8.1-3.0.rc1
v1.11.0-3.0.rc3
v1.8.1-3.0.rc2
v1.5.0-3.0.rc3
v1.5.0-3.0.rc2
2.0.4.tr5
v1.5.0-3.0.rc1
2.0.2.tr5
2.0.3.tr5
v7.2.RC1.alpha002-pytorch2.8.0
v7.2.RC1.alpha002-pytorch2.7.1
v7.2.RC1.alpha002-pytorch2.6.0
v7.2.RC1.alpha002-pytorch2.1.0
v7.1.0.2-pytorch2.5.1
v7.1.0.2-pytorch2.6.0
v7.1.0.2-pytorch2.1.0
v7.0.0.1-pytorch2.4.0
v7.0.0.1-pytorch2.1.0
v7.2.RC1.alpha001-pytorch2.8.0
v7.2.RC1.alpha001-pytorch2.7.1
v7.2.RC1.alpha001-pytorch2.6.0
v7.2.RC1.alpha001-pytorch2.5.1
v7.2.RC1.alpha001-pytorch2.1.0
v7.1.0.1-pytorch2.6.0
v7.1.0.1-pytorch2.5.1
v7.1.0.1-pytorch2.1.0
v7.1.0-pytorch2.6.0
v7.1.0-pytorch2.5.1
v7.1.0-pytorch2.1.0
v7.1.RC1.alpha003-pytorch2.6.0
v7.1.RC1.alpha003-pytorch2.5.1
v7.1.RC1.alpha003-pytorch2.1.0
v7.1.RC1.alpha002-pytorch2.7.1
v7.1.RC1.alpha002-pytorch2.6.0
v7.1.RC1.alpha002-pytorch2.5.1
v7.1.RC1.alpha002-pytorch2.4.0
v7.1.RC1.alpha002-pytorch2.3.1
v7.1.RC1.alpha002-pytorch2.1.0
v6.0.0.1-pytorch2.4.0
v6.0.0.1-pytorch2.3.1
v6.0.0.1-pytorch2.1.0
v7.1.RC1.alpha001-pytorch2.6.0
v7.1.RC1.alpha001-pytorch2.5.1
v7.1.RC1.alpha001-pytorch2.4.0
v7.1.RC1.alpha001-pytorch2.3.1
v7.1.RC1.alpha001-pytorch2.1.0
v7.0.0-pytorch2.5.1
v7.0.0-pytorch2.4.0
v7.0.0-pytorch2.3.1
v7.0.RC1.alpha002-pytorch2.6.0
v7.0.0-pytorch2.1.0
v7.0.RC1.alpha002-pytorch2.5.1
v7.0.RC1.alpha002-pytorch2.4.0
v7.0.RC1.alpha002-pytorch2.3.1
v7.0.RC1.alpha002-pytorch2.1.0
v7.0.RC1.alpha001-pytorch2.5.1
v7.0.RC1.alpha001-pytorch2.1.0
v7.0.RC1.alpha001-pytorch2.4.0
v7.0.RC1.alpha001-pytorch2.3.1
v6.0.0-pytorch2.4.0
v6.0.0-pytorch2.3.1
v6.0.0-pytorch2.1.0
v6.0.0.alpha003-pytorch2.4.0
v6.0.0.alpha003-pytorch2.3.1
v6.0.0.alpha003-pytorch2.1.0
v6.0.0.alpha002-pytorch2.4.0
v6.0.0.alpha002-pytorch2.3.1
v6.0.0.alpha002-pytorch2.1.0
v6.0.0.alpha001-pytorch2.5.1
v6.0.rc3-pytorch2.4.0
v6.0.rc3-pytorch2.3.1
v6.0.rc3-pytorch2.1.0
v6.0.0.alpha001-pytorch2.4.0
v6.0.0.alpha001-pytorch2.3.1
v6.0.0.alpha001-pytorch2.1.0
v6.0.rc2.1-pytorch1.11.0
v6.0.rc2.1-pytorch2.3.1
v6.0.rc2.1-pytorch2.2.0
v6.0.rc2.1-pytorch2.1.0
v6.0.rc3.alpha003-pytorch2.3.1
v6.0.rc3.alpha003-pytorch2.1.0
v6.0.rc3.alpha001-pytorch2.4.0
v6.0.rc3.alpha002-pytorch2.3.1
v6.0.rc3.alpha002-pytorch2.2.0
v6.0.rc3.alpha002-pytorch2.1.0
v6.0.rc3.alpha002-pytorch1.11.0
v6.0.rc2-pytorch2.1.0
v6.0.rc2-pytorch2.3.1
v6.0.rc2-pytorch2.2.0
v6.0.rc2-pytorch1.11.0
v6.0.rc3.alpha001-pytorch2.3.1
v6.0.rc3.alpha001-pytorch2.2.0
v6.0.rc3.alpha001-pytorch2.1.0
v6.0.rc3.alpha001-pytorch1.11.0
v6.0.rc2.alpha002-pytorch2.3.1
v6.0.rc2.alpha003-pytorch1.11.0
v6.0.rc2.alpha003-pytorch2.2.0
v6.0.rc2.alpha003-pytorch2.1.0
v6.0.rc1.1-pytorch2.2.0
v6.0.rc1.1-pytorch2.1.0
v6.0.rc1.1-pytorch1.11.0
v5.0.1.2-pytorch1.11.0
v5.0.1.2-pytorch2.1.0
v5.0.1.2-pytorch2.0.1
v6.0.rc2.alpha002-pytorch2.2.0
v6.0.rc2.alpha002-pytorch2.1.0
v6.0.rc2.alpha002-pytorch1.11.0
v6.0.rc1-pytorch2.2.0
v6.0.rc1-pytorch2.1.0
v6.0.rc1-pytorch1.11.0
v6.0.rc2.alpha001-pytorch2.2.0
v6.0.rc2.alpha001-pytorch2.1.0
v6.0.rc2.alpha001-pytorch1.11.0
v6.0.rc1.alpha003-pytorch2.0.1
v6.0.rc1.alpha003-pytorch2.1.0
v5.0.1.1-pytorch2.0.1
v5.0.1.1-pytorch1.11.0
v5.0.1.1-pytorch2.1.0
v6.0.rc1.alpha003-pytorch1.11.0
v6.0.rc1.alpha002-pytorch2.1.0
v6.0.rc1.alpha002-pytorch1.11.0
v6.0.rc1.alpha002-pytorch2.0.1
v6.0.rc1.alpha001-pytorch2.2.0
v5.0.1-pytorch2.1.0
v5.0.1-pytorch2.0.1
v5.0.1-pytorch1.11.0
v6.0.RC1.alpha001-pytorch2.0.1
v6.0.RC1.alpha001-pytorch2.1.0
v6.0.RC1.alpha001-pytorch1.11.0
v5.0.0-pytorch2.1.0
v5.0.0-pytorch2.0.1
v5.0.0-pytorch1.11.0
v5.0.0.alpha003-pytorch2.1.0
v5.0.0.alpha003-pytorch2.0.1
v5.0.0.alpha003-pytorch1.11.0
v5.0.rc3.3-pytorch1.11.0
v5.0.rc3.2-pytorch1.11.0
v5.0.0.alpha002-pytorch2.1.0
v5.0.0.alpha002-pytorch2.0.1
v5.0.0.alpha002-pytorch1.11.0
v5.0.rc3.1-pytorch1.11.0
v5.0.0.alpha001-pytorch2.1.0
v5.0.0.alpha001-pytorch2.0.1
v5.0.0.alpha001-pytorch1.11.0
v5.0.rc3-pytorch2.1.0
v5.0.rc3-pytorch2.0.1
v5.0.rc3-pytorch1.11.0
v5.0.rc3.alpha003-pytorch2.0.1
v5.0.rc3.alpha003-pytorch1.11.0
v5.0.rc3.alpha003-pytorch1.8.1
v5.0.rc2.2-pytorch1.11.0
v5.0.rc2.1-pytorch1.11.0
v5.0.rc3.alpha002-pytorch2.0.1
v5.0.rc3.alpha002-pytorch1.11.0
v5.0.rc3.alpha002-pytorch1.8.1
v5.0.rc2-pytorch2.0.1
v5.0.rc2-pytorch1.11.0
v5.0.rc2-pytorch1.8.1
v5.0.rc3.alpha001-pytorch1.8.1
v5.0.rc3.alpha001-pytorch1.11.0
v5.0.rc2.alpha003-pytorch1.11.0
v5.0.rc2.alpha003-pytorch1.8.1
v5.0.rc2.alpha002-pytorch1.11.0
v5.0.rc2.alpha002-pytorch1.8.1
v5.0.rc1.alpha003-pytorch1.11.0
v5.0.rc1.alpha003-pytorch1.8.1
v5.0.rc1-pytorch1.11.0
v5.0.rc1-pytorch1.8.1
v5.0.rc1.alpha002-pytorch1.11.0
v5.0.rc1.alpha002-pytorch1.8.1
v5.0.rc1.alpha001-pytorch1.11.0
v5.0.rc1.alpha001-pytorch1.8.1
v3.0.0-pytorch1.11.0
v3.0.0-pytorch1.8.1
v3.0.0-pytorch1.5.0
v3.0.alpha006-pytorch1.8.1
v3.0.alpha005-pytorch1.8.1
v3.0.alpha003-pytorch1.8.1
v3.0.rc3-pytorch1.11.0
v3.0.rc3-pytorch1.8.1
v3.0.rc3-pytorch1.5.0
v3.0.rc2-pytorch1.8.1
v3.0.rc2-pytorch1.5.0
v3.0.rc1-pytorch1.8.1
v3.0.rc1-pytorch1.5.0
v2.0.4
v2.0.4-rc2
v2.0.4-rc1
v2.0.3.1
v2.0.3
v2.0.3-rc4
v2.0.3-rc3
v2.0.3-rc2
v2.0.3-rc1
v2.0.2
开始日期 - 截止日期
-
置顶选项
不置顶
置顶等级：高
置顶等级：中
置顶等级：低
优先级
不指定
严重
主要
次要
不重要
预计工期
（小时）
参与者（1）
Python
1
https://gitee.com/ascend/pytorch.git
git@gitee.com:ascend/pytorch.git
ascend
pytorch
pytorch
点此查找更多帮助
搜索帮助
Git 命令在线学习
如何在 Gitee 导入 GitHub 仓库
Git 仓库基础操作
企业版和社区版功能对比
SSH 公钥设置
如何处理代码冲突
仓库体积过大，如何减小？
如何找回被删除的仓库数据
Gitee 产品配额说明
GitHub仓库快速导入Gitee及同步更新
什么是 Release（发行版）
将 PHP 项目自动发布到 packagist.org
仓库举报
回到顶部
登录提示
该操作需登录 Gitee 帐号，请先登录后再操作。
立即登录
没有帐号，去注册
