【Atlas800 9000 A2】【训练解决方案】【模型训练】MindSpore 2.0.0.B290版本1980B Euler2.10 OS环境模型训练进入cpu分支，导致模型训练失败

【Atlas800 9000 A2】【训练解决方案】【模型训练】MindSpore 2.0.0.B290版本1980B Euler2.10 OS环境模型训练进入cpu分支，导致模型训练失败
## Environment
- **Hardware Environment(`Ascend`/`GPU`/`CPU`)**: 
Ascend Training Solution 23.0.RC2.B020
https://cmc-szv.clouddragon.huawei.com/cmcversion/index/releaseView?deltaId=7717216634732928&isSelect=Software
MindSpore 2.0.0.B290
https://cmc-rnd.tools.huawei.com/cmcversion/index/releaseView?deltaId=7512662374220160&isSelect=Software&url_data=mindspore
Ascend HDK 23.0.RC2.B020
https://cmc-szv.clouddragon.huawei.com/cmcversion/index/releaseView?deltaId=8145984937984256&isSelect=Software
CANN 6.3.RC2.B020
https://cmc-szv.clouddragon.huawei.com/cmcversion/index/releaseView?deltaId=8153997437108480&isSelect=Software
> Uncomment only one ` /device <>` line, hit enter to put that in a new line, and remove leading whitespaces from that line:
> /device ascend
- **Software Environment**:
-- MindSpore version (source or binary):MindSpore 2.0.0.B290
-- Python version (e.g., Python 3.7.5):Python 3.7.5
-- OS platform and distribution (e.g., Linux Euler2.10)4.19.90-2107.6.0.0098.oe1.bclinux.aarch64
-- GCC/Compiler version (if compiled from source): 
## Related testcase
Ms框架下模型训练
## Steps to reproduce the issue
1. get code from https://gitee.com/mindspore/models.git
2. 环境:  90.90.2.57/58
3. 路径：
拉起对应模型的训练脚本
 bash run_distribute_train.sh /home/CI_daily/Train_MS/rank_table.json /home/data/imagenet/train /home/CI_daily/Train_MS/mindspore/official/cv/ResNet/config/resnet50_imagenet2012_Boost_config.yaml
## Describe the current behavior
模型训练失败
模型训练日志报错：
{'enable_modelarts': 'Whether training on modelarts, default: False', 'data_url': 'Dataset url for obs', 'checkpoint_url': 'The location of checkpoint for obs', 'data_path': 'Dataset path for local', 'output_path': 'Training output path for local', 'load_path': 'The location of checkpoint for obs', 'device_target': 'Target device type, available: [Ascend, GPU, CPU]', 'enable_profiling': 'Whether enable profiling while training, default: False', 'num_classes': 'Class for dataset', 'batch_size': 256, 'epoch_size': 5, 'checkpoint_path': 'The location of the checkpoint file.', 'checkpoint_file_path': 'The location of the checkpoint file.', 'save_graphs': 'Whether save graphs during training, default: False.', 'save_graphs_path': 'Path to save graphs.'}
Please check the above information for the configurations
/usr/local/python3.7.5/lib/python3.7/site-packages/pandas/compat/__init__.py:124: UserWarning: Could not import the lzma module. Your installed Python is incomplete. Attempting to use lzma compression will result in a RuntimeError.
  warnings.warn(msg)
[WARNING] ME(43:281473703695104,MainProcess):2023-05-22-20:16:13.289.06 [mindspore/run_check/_check_version.py:331] MindSpore version 2.1.0 and Ascend AI software package (Ascend Data Center Solution)version 6.4 does not match, the version of software package expect one of ['6.11', '6.3']. Please refer to the match info on: https://www.mindspore.cn/install
[WARNING] ME(43:281473703695104,MainProcess):2023-05-22-20:16:13.290.78 [mindspore/run_check/_check_version.py:461] Can not find driver so(need by mindspore-ascend). Please check whether the Environment Variable LD_LIBRARY_PATH is set. For details, refer to the installation guidelines: https://www.mindspore.cn/install
Traceback (most recent call last):
  File "train.py", line 233, in <module>
    train_net()
  File "/home/CI_daily/Train_MS/mindspore/official/cv/ResNet/scripts/train_parallel0/src/model_utils/moxing_adapter.py", line 104, in wrapped_func
    run_func(*args, **kwargs)
  File "train.py", line 140, in train_net
    set_parameter()
  File "train.py", line 75, in set_parameter
    save_graphs_path=rank_save_graphs_path)
  File "/usr/local/python3.7.5/lib/python3.7/site-packages/mindspore/_checkparam.py", line 1303, in wrapper
    return func(*args, **kwargs)
  File "/usr/local/python3.7.5/lib/python3.7/site-packages/mindspore/context.py", line 1183, in set_context
    ctx.set_device_target(kwargs['device_target'])
  File "/usr/local/python3.7.5/lib/python3.7/site-packages/mindspore/context.py", line 323, in set_device_target
    self.set_param(ms_ctx_param.device_target, target)
  File "/usr/local/python3.7.5/lib/python3.7/site-packages/mindspore/context.py", line 176, in set_param
    self._context_handle.set_param(param, value)
RuntimeError: Unsupported device target Ascend. This process only supports one of the ['CPU']. Please check whether the Ascend environment is installed and configured correctly, and check whether current mindspore wheel package was built with "-e Ascend". For details, please refer to "Device load error message".

----------------------------------------------------
- Device load error message:
----------------------------------------------------
Load dynamic library: libmindspore_ascend.so.2 failed. /usr/local/python3.7.5/lib/python3.7/site-packages/mindspore/lib/plugin/libmindspore_ascend.so.2: undefined symbol: _ZN9mindspore9transform9OpAdapterIN2ge2op19NonMaxSuppressionV3EE9attr_map_E
Load dynamic library: libmindspore_ascend.so.1 failed.

----------------------------------------------------
- C++ Call Stack: (For framework developers)
----------------------------------------------------
mindspore/core/utils/ms_context.cc:311 SetDeviceTargetFromInne

## Environment
90.90.2.58 root/DCauto1!2@
## Related log / screenshot
## Special notes for this issue

## 定位开发：胡彬 00679185

MindSpore/models

内容风险标识

评论 (8)

MindSpore/models .gitee-modal { width: 500px !important; }

内容风险标识