glm-4v-9b部署报错

一、问题现象（附报错日志上下文）：
The old environment variable ATB_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.

The old environment variable ATB_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.

The old environment variable MINDIE_LLM_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.

The old environment variable MINDIE_LLM_PYTHON_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.

The old environment variable MINDIE_LLM_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.

The old environment variable MINDIE_LLM_PYTHON_LOG_PATH will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_PATH as soon as possible.

The old environment variable ATB_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.

The old environment variable MINDIE_LLM_PYTHON_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.

The old environment variable MINDIE_LLM_PYTHON_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.

The old environment variable MINDIE_LLM_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.

The old environment variable OCK_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.

The old environment variable OCK_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.

2025-06-04 14:00:04.882 6165 LLM log default format: [yyyy-mm-dd hh:mm:ss.uuuuuu] [processid] [threadid] [llm] [loglevel] [file:line] [status code] msg

[2025-06-04 14:00:04.882] [6163] [281472915791840] [llm] [INFO] [llm_manager_impl.cpp:76] LLMRuntime init success!

[2025-06-04 14:00:10.103] [6163] [281472915791840] [llm] [ERROR] [model_deploy_config.cpp:102] Failed to get vocab size from tokenizer wrapper with exception: ValueError: safe_get_tokenizer_from_pretrained failed. Please check the input parameters model_path and kwargs. If the input parameters are valid and the required files exist in model_path, make sure the folder's owner has execute permission. Otherwise, please check the function stack for detailed exception information.

At:

/usr/local/Ascend/atb-models/atb_llm/models/base/model_utils.py(251): wrapper

/usr/local/Ascend/atb-models/atb_llm/models/base/router.py(330): get_tokenizer

/usr/local/Ascend/atb-models/atb_llm/models/base/router.py(158): tokenizer

/usr/local/Ascend/atb-models/atb_llm/runner/tokenizer_wrapper.py(20): __init__

/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(8): __init__

/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py(28): get_tokenizer_wrapper

[2025-06-04 14:00:10.104] [6163] [281472915791840] [llm] [ERROR] [llm_manager_impl.cpp:784] Config manager init exception: ValueError: safe_get_tokenizer_from_pretrained failed. Please check the input parameters model_path and kwargs. If the input parameters are valid and the required files exist in model_path, make sure the folder's owner has execute permission. Otherwise, please check the function stack for detailed exception information.

At:

/usr/local/Ascend/atb-models/atb_llm/models/base/model_utils.py(251): wrapper

/usr/local/Ascend/atb-models/atb_llm/models/base/router.py(330): get_tokenizer

/usr/local/Ascend/atb-models/atb_llm/models/base/router.py(158): tokenizer

/usr/local/Ascend/atb-models/atb_llm/runner/tokenizer_wrapper.py(20): __init__

/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(8): __init__

/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py(28): get_tokenizer_wrapper

LLMInferEngine failed to init LLMInferModels

[2025-06-04 14:00:10.104+08:00] [6163] [6165] [server] [ERROR] [llm_infer_model_instance.cpp:284] : MIE05E040001[llm_backend] [LLMInferModelInstance::Init] llmManager_ init fail!

[2025-06-04 14:00:10.104+08:00] [6163] [6165] [server] [ERROR] [llm_infer_model.cpp:28] : MIE05E040001[llm_backend] ModelInstance init failed

[2025-06-04 14:00:10.104+08:00] [6163] [6165] [server] [ERROR] [llm_infer_engine.cpp:41] : MIE05E040001[llm_backend] LLMInferEngine initialize LLMInferModels failed. please check the error stacks for more details

[2025-06-04 14:00:10.104+08:00] [6163] [54a2b51f27b3] [system] [server] [Start engine(mindieservice_llm_engine)] [fail]

[2025-06-04 14:00:10.104+08:00] [6163] [6165] [server] [ERROR] [infer_backend_manager.cpp:216] : [MIE04E06011C] [infer_backend_manager] Failed to init engine. backendName is mindieservice_llm_engine

[2025-06-04 14:00:10.105+08:00] [6163] [6165] [server] [ERROR] [endpoint.cpp:45] : [MIE04E02011C] [endpoint] Failed to init engine! Please check in the env MINDIE_LOG_PATH (default ~/mindie/log) or console output.

[2025-06-04 14:00:10.105+08:00] [6163] [54a2b51f27b3] [system] [server] [Start mindie server] [fail]

Killed

二、软件版本:
镜像：swr.cn-south-1.myhuaweicloud.com/ascendhub/mindie:2.0.RC2-800I-A2-py311-openeuler24.03-lts

Ascend/ModelZoo-PyTorch
暂停

内容风险标识

评论 (2)

Ascend/ModelZoo-PyTorch暂停 .gitee-modal { width: 500px !important; }

内容风险标识