编译报错： torch/extension.h: No such file or directory

一、问题现象（附报错日志上下文）：
编译安装报 torch/extension.h: No such file or directory
日志：
running build_ext
building 'apex_C' extension
creating build/temp.linux-aarch64-cpython-38
creating build/temp.linux-aarch64-cpython-38/csrc
aarch64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -I/usr/lib/python3.8/site-packages/torch/include -I/usr/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/usr/include/python3.8 -c csrc/flatten_unflatten.cpp -o build/temp.linux-aarch64-cpython-38/csrc/flatten_unflatten.o -fPIE -fPIC -fstack-protector-all -Wall "-D__FILENAME__=\"$(notdir $(abspath $<))\"" -std=c++17
csrc/flatten_unflatten.cpp:16:10: fatal error: torch/extension.h: No such file or directory
   16 | #include <torch/extension.h>
      |          ^~~~~~~~~~~~~~~~~~~
compilation terminated.
error: command '/usr/bin/aarch64-linux-gnu-gcc' failed with exit code 1

二、软件版本:
-- CANN 版本 (e.g., CANN 3.0.x，5.x.x):   8.0.RC2.alpha002
--Tensorflow/Pytorch/MindSpore 版本:    Pytorch-2.1.0
--Python 版本 (e.g., Python 3.7.5):     Python 3.8.10
-- MindStudio版本 (e.g., MindStudio 2.0.0 (beta3)): 无 
--操作系统版本 (e.g., Ubuntu 18.04): Ubuntu 20.04.5

三、测试步骤：
执行脚本
bash scripts/build.sh  --python=3.8

四、日志信息:
running build_ext
building 'apex_C' extension
creating build/temp.linux-aarch64-cpython-38
creating build/temp.linux-aarch64-cpython-38/csrc
aarch64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -I/usr/lib/python3.8/site-packages/torch/include -I/usr/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/usr/include/python3.8 -c csrc/flatten_unflatten.cpp -o build/temp.linux-aarch64-cpython-38/csrc/flatten_unflatten.o -fPIE -fPIC -fstack-protector-all -Wall "-D__FILENAME__=\"$(notdir $(abspath $<))\"" -std=c++17
csrc/flatten_unflatten.cpp:16:10: fatal error: torch/extension.h: No such file or directory
   16 | #include <torch/extension.h>
      |          ^~~~~~~~~~~~~~~~~~~
compilation terminated.
error: command '/usr/bin/aarch64-linux-gnu-gcc' failed with exit code 1

同样的问题

你好后来怎么解决的

同样的问题，华为根本不解决。
[root@huawei2 ~]# 
[root@huawei2 ~]# cd apex/
[root@huawei2 apex]# bash scripts/build.sh --python=3.7
setup.py:104: UserWarning: Option --pyprof not specified. Not installing PyProf dependencies!
  warnings.warn("Option --pyprof not specified. Not installing PyProf dependencies!")
running bdist_wheel
running build
running build_py
running build_ext
building 'apex_C' extension
gcc -pthread -Wno-unused-result -Wsign-compare -DDYNAMIC_ANNOTATIONS_ENABLED=1 -DNDEBUG -D_GNU_SOURCE -fPIC -fwrapv -fPIC -I/usr/lib/python3.7/site-packages/torch/include -I/usr/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/usr/include/python3.7m -c csrc/flatten_unflatten.cpp -o build/temp.linux-aarch64-cpython-37/csrc/flatten_unflatten.o -fPIE -fPIC -fstack-protector-all -Wall "-D__FILENAME__=\"$(notdir $(abspath $<))\""
csrc/flatten_unflatten.cpp:16:10: fatal error: torch/extension.h: No such file or directory
 #include <torch/extension.h>
          ^~~~~~~~~~~~~~~~~~~
compilation terminated.
error: command '/usr/bin/gcc' failed with exit code 1

这些都不测试吗？昇腾的910B服务器，用自家的产品，按照文档操作，依然报错，这不是很可笑的事情吗？

昨晚遇到类似问题，请关注最新的pr129

还没解决

综合了楼上PR129和楼上issues，解决方案如下：
pip show torch
torch
得到位置： /usr/local/lib64/python3.11/site-packages

vim patch/npu.patch
# 直接修改第2649行，把 package_dir 手工指定为上面torch的位置，即我这个例子中的 /usr/local/lib64/python3.11/site-packages

接着

bash scripts/build.sh --python=3.11 # 我这里用的3.11

就可以生成whl文件了

Ascend/apex

内容风险标识

评论 (8)

Ascend/apex .gitee-modal { width: 500px !important; }

内容风险标识