登录
注册
开源
企业版
高校版
搜索
帮助中心
使用条款
关于我们
开源
企业版
高校版
私有云
模力方舟
AI 队友
登录
注册
4月29日周三晚 8 点,来看 PocketClaw 直播首秀,从开箱到实操全流程跑通、多场景案例演示、首次版本更新介绍,点击预约~
代码拉取完成,页面将自动刷新
仓库状态说明
开源项目
>
人工智能
>
AI-人工智能
&&
捐赠
捐赠前请先登录
取消
前往登录
扫描微信二维码支付
取消
支付完成
支付提示
将跳转至支付宝完成支付
确定
取消
Watch
不关注
关注所有动态
仅关注版本发行动态
关注但不提醒动态
105
Star
1.4K
Fork
975
GVP
MindSpore
/
mindformers
关闭
代码
Issues
159
Pull Requests
103
Wiki
统计
流水线
服务
质量分析
Jenkins for Gitee
腾讯云托管
腾讯云 Serverless
悬镜安全
阿里云 SAE
Codeblitz
SBOM
开发画像分析
我知道了,不再自动展开
更新失败,请稍后重试!
移除标识
内容风险标识
本任务被
标识为内容中包含有代码安全 Bug 、隐私泄露等敏感信息,仓库外成员不可访问
[ST][MS][2.3][mindformers][readme][llama2][大模型] 文档描述不清晰,启动方式需改成msrun启动,单卡推理失败
DONE
#I9MJ1R
Bug-Report
wenli
创建于
2024-05-06 15:02
| name | about | labels | | ---------- | ------------------------------------- | -------- | | Bug Report | Use this template for reporting a bug | kind/bug | <!-- Thanks for sending an issue! Here are some tips for you: 1) If this is your first time, please read our contributor guidelines: https://gitee.com/mindspore/mindspore/blob/master/CONTRIBUTING.md 2) If you want to get the answer quickly, please add label `mindspore-assistant` to the issue, we will find it and answer you as soon as possible. --> ### Describe the current behavior / 问题描述 (Mandatory / 必填) 文档描述不清晰,启动方式需改成msrun启动,单卡推理失败 ### Environment / 环境信息 (Mandatory / 必填) - **Hardware Environment(`Ascend`/`GPU`/`CPU`) / 硬件环境**: > Please delete the backend not involved / 请删除不涉及的后端: > /device ascend/GPU/CPU/kirin/等其他芯片 - **Software Environment / 软件环境 (Mandatory / 必填)**: -- MindSpore version (e.g., 1.7.0.Bxxx) : -- Python version (e.g., Python 3.7.5) : -- OS platform and distribution (e.g., Linux Ubuntu 16.04): -- GCC/Compiler version (if compiled from source): ms版本:__commit_id__ = '[sha1]:39ac2284,[branch]:(HEAD,origin/master,origin/HEAD,master)' mf版本: dev commit 9d8c186 Merge: a709b59 d836b61 Author: i-robot <huawei_ci_bot@163.com> Date: Tue Apr 30 09:12:29 2024 +0000 !2892 【dev】Baichuan2-13B动态shape推理精度问题修复 Merge pull request !2892 from renyujin/baichuan2_13b_dynamic_fix - **Excute Mode / 执行模式 (Mandatory / 必填)(`PyNative`/`Graph`)**: > Please delete the mode not involved / 请删除不涉及的模式: > /mode pynative > /mode graph ### Related testcase / 关联用例 (Mandatory / 必填) 不涉及 ### Steps to reproduce the issue / 重现步骤 (Mandatory / 必填) 不涉及 ### Describe the expected behavior / 预期结果 (Mandatory / 必填) 文档描述清晰,用户看了知道怎么操作 多卡启动方式需换成msrun启动 推理正常 ### Related log / screenshot / 日志 / 截图 (Mandatory / 必填) # 问题1:推理-基本介绍里,没说明配置文件是哪个 推理时将配置文件中param_init_type修改为float32;若为Atlas 800T A2推理,则加入ascend_config配置。 # 问题2:多卡运行自定义多batch推理的脚本需换成msrun启动 \# >>> `run_predict.sh`文件 export RANK_TABLE_FILE=$1 CHECKPOINT_PATH=$2 YAML_FILE=$3 MODEL_TYPE=$4 \# define variable export RANK_SIZE=$5 export START_RANK=$6 # this server start rank let END_RANK=START_RANK+RANK_SIZE # this server end rank \# run for((i=${START_RANK}; i<${END_RANK}; i++)) do export RANK_ID=$((i-START_RANK)) export DEVICE_ID=$i echo "Start distribute running for rank $RANK_ID, device $DEVICE_ID" python3 ./predict_custom.py --checkpoint_path $CHECKPOINT_PATH --yaml_file ${YAML_FILE} --model_type ${MODEL_TYPE} &> mindformers_$RANK_ID.log & done # 问题3:单卡推理失败,ckpt下载失败 2024-05-06 15:39:38,050 - mindformers[mindformers/tools/download_tools.py:72] - ERROR - Connect error, please download https://ascend-repo-modelzoo.obs.cn-east-2.myhuaweicloud.com/MindFormers/llama2/tokenizer.model to ./checkpoint_download/llama2/tokenizer.model. Traceback (most recent call last): File "predict_custom.py", line 82, in <module> main(args) File "predict_custom.py", line 39, in main tokenizer = AutoTokenizer.from_pretrained(args.model_type) File "/home/miniconda3/envs/ci/lib/python3.7/site-packages/mindformers/models/auto/tokenization_auto.py", line 347, in from_pretrained instanced_class = cls.get_class_from_origin_mode(yaml_name_or_path, **kwargs) File "/home/miniconda3/envs/ci/lib/python3.7/site-packages/mindformers/models/auto/tokenization_auto.py", line 412, in get_class_from_origin_mode instanced_class = dynamic_class.from_pretrained(yaml_name_or_path, **kwargs) File "/home/miniconda3/envs/ci/lib/python3.7/site-packages/mindformers/models/tokenization_utils_base.py", line 1836, in from_pretrained tokenizer = cls.from_origin_pretrained(name_or_path, **kwargs) File "/home/miniconda3/envs/ci/lib/python3.7/site-packages/mindformers/models/tokenization_utils_base.py", line 1872, in from_origin_pretrained config, cache_path = cls._download_using_name(name_or_path) File "/home/miniconda3/envs/ci/lib/python3.7/site-packages/mindformers/models/tokenization_utils_base.py", line 1959, in _download_using_name try_sync_file(file_path) File "/home/miniconda3/envs/ci/lib/python3.7/site-packages/mindformers/tools/utils.py", line 315, in try_sync_file with open(file_name, 'r') as fp: FileNotFoundError: [Errno 2] No such file or directory: './checkpoint_download/llama2/tokenizer.model' ### Special notes for this issue/备注 (Optional / 选填) 走给 冯浩
| name | about | labels | | ---------- | ------------------------------------- | -------- | | Bug Report | Use this template for reporting a bug | kind/bug | <!-- Thanks for sending an issue! Here are some tips for you: 1) If this is your first time, please read our contributor guidelines: https://gitee.com/mindspore/mindspore/blob/master/CONTRIBUTING.md 2) If you want to get the answer quickly, please add label `mindspore-assistant` to the issue, we will find it and answer you as soon as possible. --> ### Describe the current behavior / 问题描述 (Mandatory / 必填) 文档描述不清晰,启动方式需改成msrun启动,单卡推理失败 ### Environment / 环境信息 (Mandatory / 必填) - **Hardware Environment(`Ascend`/`GPU`/`CPU`) / 硬件环境**: > Please delete the backend not involved / 请删除不涉及的后端: > /device ascend/GPU/CPU/kirin/等其他芯片 - **Software Environment / 软件环境 (Mandatory / 必填)**: -- MindSpore version (e.g., 1.7.0.Bxxx) : -- Python version (e.g., Python 3.7.5) : -- OS platform and distribution (e.g., Linux Ubuntu 16.04): -- GCC/Compiler version (if compiled from source): ms版本:__commit_id__ = '[sha1]:39ac2284,[branch]:(HEAD,origin/master,origin/HEAD,master)' mf版本: dev commit 9d8c186 Merge: a709b59 d836b61 Author: i-robot <huawei_ci_bot@163.com> Date: Tue Apr 30 09:12:29 2024 +0000 !2892 【dev】Baichuan2-13B动态shape推理精度问题修复 Merge pull request !2892 from renyujin/baichuan2_13b_dynamic_fix - **Excute Mode / 执行模式 (Mandatory / 必填)(`PyNative`/`Graph`)**: > Please delete the mode not involved / 请删除不涉及的模式: > /mode pynative > /mode graph ### Related testcase / 关联用例 (Mandatory / 必填) 不涉及 ### Steps to reproduce the issue / 重现步骤 (Mandatory / 必填) 不涉及 ### Describe the expected behavior / 预期结果 (Mandatory / 必填) 文档描述清晰,用户看了知道怎么操作 多卡启动方式需换成msrun启动 推理正常 ### Related log / screenshot / 日志 / 截图 (Mandatory / 必填) # 问题1:推理-基本介绍里,没说明配置文件是哪个 推理时将配置文件中param_init_type修改为float32;若为Atlas 800T A2推理,则加入ascend_config配置。 # 问题2:多卡运行自定义多batch推理的脚本需换成msrun启动 \# >>> `run_predict.sh`文件 export RANK_TABLE_FILE=$1 CHECKPOINT_PATH=$2 YAML_FILE=$3 MODEL_TYPE=$4 \# define variable export RANK_SIZE=$5 export START_RANK=$6 # this server start rank let END_RANK=START_RANK+RANK_SIZE # this server end rank \# run for((i=${START_RANK}; i<${END_RANK}; i++)) do export RANK_ID=$((i-START_RANK)) export DEVICE_ID=$i echo "Start distribute running for rank $RANK_ID, device $DEVICE_ID" python3 ./predict_custom.py --checkpoint_path $CHECKPOINT_PATH --yaml_file ${YAML_FILE} --model_type ${MODEL_TYPE} &> mindformers_$RANK_ID.log & done # 问题3:单卡推理失败,ckpt下载失败 2024-05-06 15:39:38,050 - mindformers[mindformers/tools/download_tools.py:72] - ERROR - Connect error, please download https://ascend-repo-modelzoo.obs.cn-east-2.myhuaweicloud.com/MindFormers/llama2/tokenizer.model to ./checkpoint_download/llama2/tokenizer.model. Traceback (most recent call last): File "predict_custom.py", line 82, in <module> main(args) File "predict_custom.py", line 39, in main tokenizer = AutoTokenizer.from_pretrained(args.model_type) File "/home/miniconda3/envs/ci/lib/python3.7/site-packages/mindformers/models/auto/tokenization_auto.py", line 347, in from_pretrained instanced_class = cls.get_class_from_origin_mode(yaml_name_or_path, **kwargs) File "/home/miniconda3/envs/ci/lib/python3.7/site-packages/mindformers/models/auto/tokenization_auto.py", line 412, in get_class_from_origin_mode instanced_class = dynamic_class.from_pretrained(yaml_name_or_path, **kwargs) File "/home/miniconda3/envs/ci/lib/python3.7/site-packages/mindformers/models/tokenization_utils_base.py", line 1836, in from_pretrained tokenizer = cls.from_origin_pretrained(name_or_path, **kwargs) File "/home/miniconda3/envs/ci/lib/python3.7/site-packages/mindformers/models/tokenization_utils_base.py", line 1872, in from_origin_pretrained config, cache_path = cls._download_using_name(name_or_path) File "/home/miniconda3/envs/ci/lib/python3.7/site-packages/mindformers/models/tokenization_utils_base.py", line 1959, in _download_using_name try_sync_file(file_path) File "/home/miniconda3/envs/ci/lib/python3.7/site-packages/mindformers/tools/utils.py", line 315, in try_sync_file with open(file_name, 'r') as fp: FileNotFoundError: [Errno 2] No such file or directory: './checkpoint_download/llama2/tokenizer.model' ### Special notes for this issue/备注 (Optional / 选填) 走给 冯浩
评论 (
5
)
登录
后才可以发表评论
状态
DONE
TODO
ACCEPTED
WIP
VALIDATION
DONE
CLOSED
REJECTED
负责人
未设置
wenli
wl835546292
负责人
协作者
+负责人
+协作者
xiangminshan
xiangmd
负责人
协作者
+负责人
+协作者
冯浩
michealswhite
负责人
协作者
+负责人
+协作者
hsshuai
hss-shuai
负责人
协作者
+负责人
+协作者
标签
attr/function
device/ascend
kind/usability
bug
未设置
项目
未立项任务
未立项任务
里程碑
B-SolutionTest
未关联里程碑
Pull Requests
未关联
未关联
关联的 Pull Requests 被合并后可能会关闭此 issue
分支
未关联
分支 (
-
)
标签 (
-
)
开始日期   -   截止日期
-
置顶选项
不置顶
置顶等级:高
置顶等级:中
置顶等级:低
优先级
不指定
严重
主要
次要
不重要
预计工期
(小时)
参与者(4)
Python
1
https://gitee.com/mindspore/mindformers.git
git@gitee.com:mindspore/mindformers.git
mindspore
mindformers
mindformers
点此查找更多帮助
搜索帮助
Git 命令在线学习
如何在 Gitee 导入 GitHub 仓库
Git 仓库基础操作
企业版和社区版功能对比
SSH 公钥设置
如何处理代码冲突
仓库体积过大,如何减小?
如何找回被删除的仓库数据
Gitee 产品配额说明
GitHub仓库快速导入Gitee及同步更新
什么是 Release(发行版)
将 PHP 项目自动发布到 packagist.org
评论
仓库举报
回到顶部
登录提示
该操作需登录 Gitee 帐号,请先登录后再操作。
立即登录
没有帐号,去注册