登录
注册
开源
企业版
高校版
搜索
帮助中心
使用条款
关于我们
开源
企业版
高校版
私有云
模力方舟
AI 队友
登录
注册
【大赛通知】开源中国「2026北京开源行业解决方案创新赛」火热报名中,百万奖池等你的项目
代码拉取完成,页面将自动刷新
仓库状态说明
开源项目
>
人工智能
>
AI-人工智能
&&
Watch
不关注
关注所有动态
仅关注版本发行动态
关注但不提醒动态
108
Star
1.4K
Fork
984
GVP
MindSpore
/
mindformers
关闭
代码
Issues
159
Pull Requests
100
Wiki
统计
流水线
服务
质量分析
Jenkins for Gitee
腾讯云托管
腾讯云 Serverless
悬镜安全
阿里云 SAE
Codeblitz
SBOM
开发画像分析
我知道了,不再自动展开
3568
增加run_check功能
已合并
MindSpore:run_check
MindSpore:dev
AAA碧根果批发赵少
创建于 2024-07-19 12:05
克隆/下载
HTTPS
SSH
复制
下载 Email Patch
下载 Diff 文件
### 相关的Issue ### 原因(目的、解决的问题等) 增加run_check功能 ### 描述(做了什么,变更了什么) 增加run_check功能 ### check list - 获取各软件版本信息并打印 - 检查版本是否配套 - 调用Mindspore run_check接口 - 运行微调程序验证环境 #### 是否完成方案评审或问题根因分析(Y/N) N #### 是否完成了功能模块的UT/ST,并执行通过,附上结果(Y/N) **受限于篇幅,所有非本功能打印的日志均已隐藏,用户可通过调用run_check时传递log_level参数来控制** 1. 全部运行成功,耗时基本可以控制在50s内 ```text 2024-08-04 13:15:55,805 - mindformers[mindformers/run_check.py:148] - INFO - ------------------------------Starting MindSpore Run Check------------------------------ 2024-08-04 13:15:59,687 - mindformers[mindformers/run_check.py:161] - INFO - The result of multiplication calculation is correct, MindSpore has been installed on platform [Ascend] successfully! 2024-08-04 13:15:59,688 - mindformers[mindformers/run_check.py:165] - INFO - ------------------------------Starting Pretrain Test------------------------------ 2024-08-04 13:16:20,727 - mindformers[mindformers/run_check.py:180] - INFO - Pretrain test passed! 2024-08-04 13:16:20,727 - mindformers[mindformers/run_check.py:181] - INFO - ------------------------------Starting Predict Test------------------------------ 2024-08-04 13:16:22,065 - mindformers[mindformers/run_check.py:191] - INFO - Predict test passed! 2024-08-04 13:16:22,065 - mindformers[mindformers/run_check.py:88] - INFO - ------------------------------Searching Environment Info------------------------------ 2024-08-04 13:16:22,066 - mindformers[mindformers/run_check.py:92] - INFO - MindFormers version: 1.2.0 2024-08-04 13:16:22,066 - mindformers[mindformers/run_check.py:93] - INFO - MindSpore version: 2.3.0 2024-08-04 13:16:22,070 - mindformers[mindformers/run_check.py:105] - INFO - Ascend-cann-toolkit version: 8.0.RC2 2024-08-04 13:16:22,074 - mindformers[mindformers/run_check.py:112] - INFO - Ascend driver version: 24.1.rc2 2024-08-04 13:16:22,075 - mindformers[mindformers/run_check.py:131] - INFO - All checks passed, used 45.16 seconds, the environment is correctly set up! ``` 2. 测试均通过但版本不匹配(版本号不匹配) ```text 2024-08-05 01:50:40,877 - mindformers[mindformers/run_check.py:152] - INFO - ------------------------------Starting MindSpore Run Check------------------------------ 2024-08-05 01:50:44,828 - mindformers[mindformers/run_check.py:165] - INFO - The result of multiplication calculation is correct, MindSpore has been installed on platform [Ascend] successfully! 2024-08-05 01:50:44,829 - mindformers[mindformers/run_check.py:169] - INFO - ------------------------------Starting Pretrain Test------------------------------ 2024-08-05 01:51:06,028 - mindformers[mindformers/run_check.py:185] - INFO - Pretrain test passed! 2024-08-05 01:51:06,028 - mindformers[mindformers/run_check.py:186] - INFO - ------------------------------Starting Predict Test------------------------------ 2024-08-05 01:51:07,414 - mindformers[mindformers/run_check.py:196] - INFO - Predict test passed! 2024-08-05 01:51:07,414 - mindformers[mindformers/run_check.py:88] - INFO - ------------------------------Searching Environment Info------------------------------ 2024-08-05 01:51:07,414 - mindformers[mindformers/run_check.py:93] - INFO - MindFormers version: (。◕ ∀ ◕。) 2024-08-05 01:51:07,415 - mindformers[mindformers/run_check.py:94] - INFO - MindSpore version: 2.3.0 2024-08-05 01:51:07,420 - mindformers[mindformers/run_check.py:106] - INFO - Ascend-cann-toolkit version: 8.0.RC2 2024-08-05 01:51:07,424 - mindformers[mindformers/run_check.py:113] - INFO - Ascend driver version: 24.1.rc2 2024-08-05 01:51:07,424 - mindformers[mindformers/run_check.py:138] - WARNING - The installed software are unmatched but all checks passed in 47.60 seconds 2024-08-05 01:51:07,424 - mindformers[mindformers/run_check.py:140] - INFO - It's recommended to install cann==8.0.RC2.alpha003 mindspore==2.3.0 mindformers==1.2.0 ``` 3. Mindspore run_check失败 ```text 2024-08-07 10:40:46,836 - mindformers[mindformers/run_check.py:66] - INFO - ------------------------------Starting MindSpore Run Check------------------------------ [MS_ALLOC_CONF]Runtime config: enable_vmm:False 2024-08-07 10:40:51,287 - mindformers[mindformers/run_check.py:95] - ERROR - MindSpore failed! 2024-08-07 10:40:51,288 - mindformers[mindformers/run_check.py:96] - ERROR - failed failed 2024-08-07 10:40:51,288 - mindformers[mindformers/run_check.py:97] - INFO - The MindSpore is not installed correctly, please refer to https://www.mindspore.cn/install/ 2024-08-07 10:40:51,288 - mindformers[mindformers/run_check.py:217] - INFO - ------------------------------Searching Environment Info------------------------------ 2024-08-07 10:40:51,289 - mindformers[mindformers/run_check.py:255] - INFO - MindFormers version: 1.2.0 2024-08-07 10:40:51,289 - mindformers[mindformers/run_check.py:256] - INFO - MindSpore version: 2.3.0 2024-08-07 10:40:51,297 - mindformers[mindformers/run_check.py:269] - INFO - Ascend-cann-toolkit version: 8.0.RC2 2024-08-07 10:40:51,303 - mindformers[mindformers/run_check.py:277] - INFO - Ascend driver version: 24.1.rc2 2024-08-07 10:40:51,303 - mindformers[mindformers/run_check.py:232] - ERROR - The run check failed in 4.47 seconds, please check the above info for more details ``` 4. llama predict失败 ```text 2024-08-07 11:46:37,212 - mindformers[mindformers/run_check.py:66] - INFO - ------------------------------Starting MindSpore Run Check------------------------------ [MS_ALLOC_CONF]Runtime config: enable_vmm:False 2024-08-07 11:46:44,388 - mindformers[mindformers/run_check.py:84] - INFO - The result of multiplication calculation is correct, MindSpore has been installed on platform [Ascend] successfully! 2024-08-07 11:46:44,389 - mindformers[mindformers/run_check.py:108] - INFO - ------------------------------Starting Pretrain Test------------------------------ 2024-08-07 11:47:23,936 - mindformers[mindformers/run_check.py:152] - INFO - Pretrain test passed! 2024-08-07 11:47:23,936 - mindformers[mindformers/run_check.py:181] - INFO - ------------------------------Starting Predict Test------------------------------ 2024-08-07 11:47:23,936 - mindformers[mindformers/run_check.py:209] - ERROR - Predict test failed! Traceback (most recent call last): File "/root/mindformers/mindformers/run_check.py", line 187, in check raise RuntimeError RuntimeError 2024-08-07 11:47:23,937 - mindformers[mindformers/run_check.py:210] - INFO - If you need any help, please open an issue in the MindFormers repository: https://gitee.com/mindspore/mindformers/issues 2024-08-07 11:47:23,937 - mindformers[mindformers/run_check.py:218] - INFO - ------------------------------Searching Environment Info------------------------------ 2024-08-07 11:47:23,938 - mindformers[mindformers/run_check.py:256] - INFO - MindFormers version: 1.2.0 2024-08-07 11:47:23,938 - mindformers[mindformers/run_check.py:257] - INFO - MindSpore version: 2.3.0 2024-08-07 11:47:23,943 - mindformers[mindformers/run_check.py:270] - INFO - Ascend-cann-toolkit version: 8.0.RC2 2024-08-07 11:47:23,946 - mindformers[mindformers/run_check.py:278] - INFO - Ascend driver version: 24.1.rc2 2024-08-07 11:47:23,947 - mindformers[mindformers/run_check.py:233] - ERROR - The run check failed in 46.74 seconds, please check the above info for more details ``` 5. llama pretrain失败,版本匹配失败(找不到相关文件) ```text 2024-08-07 11:58:30,206 - mindformers[mindformers/run_check.py:66] - INFO - ------------------------------Starting MindSpore Run Check------------------------------ [MS_ALLOC_CONF]Runtime config: enable_vmm:False 2024-08-07 11:58:34,077 - mindformers[mindformers/run_check.py:84] - INFO - The result of multiplication calculation is correct, MindSpore has been installed on platform [Ascend] successfully! 2024-08-07 11:58:34,078 - mindformers[mindformers/run_check.py:108] - INFO - ------------------------------Starting Pretrain Test------------------------------ 2024-08-07 11:58:34,079 - mindformers[mindformers/run_check.py:169] - ERROR - Pretrain test failed! Traceback (most recent call last): File "/root/mindformers/mindformers/run_check.py", line 145, in check raise RuntimeError RuntimeError 2024-08-07 11:58:34,080 - mindformers[mindformers/run_check.py:170] - INFO - If you need any help, please open an issue in the MindFormers repository: https://gitee.com/mindspore/mindformers/issues 2024-08-07 11:58:34,081 - mindformers[mindformers/run_check.py:217] - INFO - ------------------------------Searching Environment Info------------------------------ 2024-08-07 11:58:34,081 - mindformers[mindformers/run_check.py:255] - INFO - MindFormers version: 1.2.0 2024-08-07 11:58:34,081 - mindformers[mindformers/run_check.py:256] - INFO - MindSpore version: 2.3.0 2024-08-07 11:58:34,081 - mindformers[mindformers/run_check.py:282] - ERROR - Cannot find cann info file 2024-08-07 11:58:34,082 - mindformers[mindformers/run_check.py:240] - ERROR - The run check failed in 3.88 seconds, It's recommended to install cann==8.0.RC2 mindspore==2.3.0 mindformers==1.2.0 ``` #### 是否涉及公共组件或对外接口修改,涉及时需给出修改范围和影响评估(Y/N) N #### 是否涉及资料修改,涉及时需同步修改(Y/N) N
此 Pull Request 需要通过一些审核项
类型
指派人员
状态
审查
guoqi
fangzehua
suhaibo
niyuxin94520
jiahongqian
Lin
huangxinliang
森镇
zyw_hw
husichao
已完成
(0/0人)
怎样手动合并此 Pull Request
git checkout dev
git pull https://gitee.com/mindspore/mindformers.git run_check
git push origin dev
评论
99
提交
1
文件
3
检查
代码问题
0
批量操作
展开设置
折叠设置
审查
Code Owner
审查人员
melody
cmy_melody
fft1374
fft1374
hsshuai
hss-shuai
wangjialin
wjlflyer
zyw_hw
zyw-hw
Xinrui Chen
chenrayray
jinyidou
jinyidou
yanghaoran
nicholas_yhr
Lin
Lin-Bert
suhaibo
suhaibo
zhulinhong
zhulinhong
AtlasAccount
atlasaccount
hpp034
hpp034
i-robot
I-am-a-robot
openLiBing-bot
openLiBing-bot
guoqi
guoqi1024
fangzehua
fangzehua
niyuxin94520
ntuxianyu
jiahongqian
jiahongqian
huangxinliang
xinlianglalala
森镇
senzhen-town
husichao
husichao
未设置
最少人数
0
测试
melody
cmy_melody
fft1374
fft1374
hsshuai
hss-shuai
wangjialin
wjlflyer
zyw_hw
zyw-hw
Xinrui Chen
chenrayray
jinyidou
jinyidou
yanghaoran
nicholas_yhr
Lin
Lin-Bert
suhaibo
suhaibo
zhulinhong
zhulinhong
AtlasAccount
atlasaccount
hpp034
hpp034
i-robot
I-am-a-robot
openLiBing-bot
openLiBing-bot
未设置
最少人数
0
优先级
不指定
严重
主要
次要
不重要
标签
approved
lgtm
mindspore-cla/yes
ci-pipeline-passed
ci-compile-passed
关联 Issue
未关联
里程碑
未关联里程碑
ZR-NEIYUAN
1.6.0
MindFormersTest
参与者
(7)
Python
1
https://gitee.com/mindspore/mindformers.git
git@gitee.com:mindspore/mindformers.git
mindspore
mindformers
mindformers
点此查找更多帮助
搜索帮助
Git 命令在线学习
如何在 Gitee 导入 GitHub 仓库
Git 仓库基础操作
企业版和社区版功能对比
SSH 公钥设置
如何处理代码冲突
仓库体积过大,如何减小?
如何找回被删除的仓库数据
Gitee 产品配额说明
GitHub仓库快速导入Gitee及同步更新
什么是 Release(发行版)
将 PHP 项目自动发布到 packagist.org
仓库举报
回到顶部
登录提示
该操作需登录 Gitee 帐号,请先登录后再操作。
立即登录
没有帐号,去注册