334 Star 1.5K Fork 863

MindSpore / docs

加入 Gitee
与超过 1200万 开发者一起发现、参与优秀开源项目,私有仓库也完全免费 :)
免费加入
克隆/下载
mindspore_ascend_install_conda_en.md 12.40 KB
一键复制 编辑 原始数据 按行查看 历史
宦晓玲 提交于 2023-07-21 16:54 . modify the md links 1.9

Installing MindSpore Ascend 910 by Conda

View Source On Gitee

Conda is an open-source, cross-platform, language-agnostic package manager and environment management system. It allows users to easily install different versions of binary software packages and any required libraries appropriate for their computing platform.

This document describes how to quickly install MindSpore in a Linux system with an Ascend 910 environment by Conda.

  • If you want to install MindSpore by Conda on an EulerOS 2.8 with Ascend AI processor software package installed, you may use automatic installation script for one-click installation, see Automatic Installation section. The automatic installation script will install MindSpore and its required dependencies.

  • If your system is one of Ubuntu 18.04/CentOS 7.6/OpenEuler 20.03/KylinV10 SP1, or some dependencies, such as Python and GCC, have been installed in your system, it is recommended to install manually by referring to the installation steps in the Manual Installation section.

Automatic Installation

Before running the automatic installation script, you need to make sure that the Ascend AI processor software package is correctly installed on your system. If it is not installed, please refer to the section Installing Ascend AI processor software package to install it.

Run the following command to obtain and run the automatic installation script. The automatic installation script only supports the installation of MindSpore>=1.6.0.

wget https://gitee.com/mindspore/mindspore/raw/r1.9/scripts/install/euleros-ascend-conda.sh
# install Python 3.7 and the latest MindSpore by default
# the default value of LOCAL_ASCEND is /usr/local/Ascend
bash -i ./euleros-ascend-conda.sh
# to specify Python and MindSpore version, taking Python 3.9 and MindSpore 1.6.0 as examples
# and set LOCAL_ASCEND to /home/xxx/Ascend, use the following manners
# LOCAL_ASCEND=/home/xxx/Ascend PYTHON_VERSION=3.9 MINDSPORE_VERSION=1.6.0 bash -i ./euleros-ascend-conda.sh

This script performs the following operations:

  • Install the dependencies required by MindSpore, such as GCC.
  • Install Conda and create a virtual environment for MindSpore.
  • Install MindSpore Ascend by Conda.
  • Install Open MPI if OPENMPI is set to on.

After the script is executed, you need to reopen the terminal window to make the environment variables take effect.

The automatic installation script creates a virtual environment named mindspore_pyXX for MindSpore. Where XX is the Python version, such as Python 3.7, the virtual environment name is mindspore_py37. Run the following command to show all virtual environments.

conda env list

To activate the virtual environment, take Python 3.7 as an example, execute the following command.

conda activate mindspore_py37

Now you can jump to the Configuring Environment Variables section to set the relevant environment variables.

For more usage, see the script header description.

Manual Installation

The following table lists the system environment and third-party dependencies required for installing MindSpore.

software version description
Ubuntu 18.04/CentOS 7.6/EulerOS 2.8/OpenEuler 20.03/KylinV10 SP1 - OS for running MindSpore
Ascend AI processor software package - Ascend platform AI computing library used by MindSpore
Conda Anaconda3 or Miniconda3 Python environment management tool
GCC 7.3.0 C++ compiler for compiling MindSpore

The following describes how to install the third-party dependencies.

Installing Ascend AI processor software package

Ascend software package provides two distributions, commercial edition and community edition:

The default installation path of the installation package is /usr/local/Ascend. Ensure that the current user has the right to access the installation path /usr/local/Ascend of Ascend AI processor software package, If not, the root user needs to add the current user to the user group where /usr/local/Ascend is located.

The LD_LIBRARY_PATH environment variable does not work when the installation package exists in the default path. The default path priority is: /usr/local/Ascend/nnae is higher than /usr/loacl/Ascend/ascend-toolkit. The reason is that MindSpore uses DT_RPATH to support startup without environment variables, reducing user settings. DT_RPATH has a higher priority than the LD_LIBRARY_PATH environment variable.

Installing Conda

Run the following command to install Miniconda.

cd /tmp
curl -O https://mirrors.tuna.tsinghua.edu.cn/anaconda/miniconda/Miniconda3-py37_4.10.3-Linux-$(arch).sh
bash Miniconda3-py37_4.10.3-Linux-$(arch).sh -b
cd -
. ~/miniconda3/etc/profile.d/conda.sh
conda init bash

After the installation is complete, you can set up Tsinghua Source to accelerate the download for Conda, and refer to Here.

Installing GCC

  • On Ubuntu 18.04, run the following commands to install.

    sudo apt-get install gcc-7 -y
  • On CentOS 7, run the following commands to install.

    sudo yum install centos-release-scl
    sudo yum install devtoolset-7

    After installation, run the following commands to switch to GCC 7.

    scl enable devtoolset-7 bash
  • On EulerOS and OpenEuler, run the following commands to install.

    sudo yum install gcc -y

Creating and Accessing the Conda Virtual Environment

Create a Conda virtual environment based on the Python version you want to use and activate the virtual environment.

If you want to use Python 3.7.5:

conda create -c conda-forge -n mindspore_py37 python=3.7.5 -y
conda activate mindspore_py37

If you wish to use another version of Python, just change the Python version in the above command. Python 3.7, Python 3.8 and Python 3.9 are currently supported.

Install the .whl package provided with the Ascend AI Processor software package in the virtual environment. The .whl package is released with the software package. After the software package is upgraded, you need to reinstall the .whl package.

pip install sympy
pip install /usr/local/Ascend/ascend-toolkit/latest/lib64/topi-{version}-py3-none-any.whl
pip install /usr/local/Ascend/ascend-toolkit/latest/lib64/te-{version}-py3-none-any.whl
pip install /usr/local/Ascend/ascend-toolkit/latest/lib64/hccl-{version}-py3-none-any.whl

If the software package of the Ascend AI processor is upgraded, the matching .whl package also needs to be reinstalled. Uninstall the original installation package and reinstall the .whl package by referring to the preceding commands.

pip uninstall te topi hccl -y

Installing MindSpore

Ensure that you are in the Conda virtual environment and run the following command to install the latest MindSpore. To install other versions, please refer to the specified the version of Version List after mindspore-ascend=.

conda install mindspore-ascend -c mindspore -c conda-forge

When the network is connected, dependencies of MindSpore are automatically downloaded during the .whl package installation. (For details about the dependency, see required_package in setup.py .) In other cases, you need to install it by yourself. When running models, you need to install additional dependencies based on requirements.txt specified for different models in ModelZoo. For details about common dependencies, see requirements.txt.

Configuring Environment Variables

If Ascend AI processor software is installed in a non-default path, after MindSpore is installed, export Runtime-related environment variables. /usr/local/Ascend in the following command LOCAL_ASCEND=/usr/local/Ascend denotes the installation path of the software package, and you need to replace it as the actual installation path of the software package.

# control log level. 0-DEBUG, 1-INFO, 2-WARNING, 3-ERROR, 4-CRITICAL, default level is WARNING.
export GLOG_v=2

# Conda environmental options
LOCAL_ASCEND=/usr/local/Ascend # the root directory of run package

# lib libraries that the run package depends on
export LD_LIBRARY_PATH=${LOCAL_ASCEND}/ascend-toolkit/latest/lib64:${LOCAL_ASCEND}/driver/lib64:${LOCAL_ASCEND}/ascend-toolkit/latest/opp/op_impl/built-in/ai_core/tbe/op_tiling:${LD_LIBRARY_PATH}

# Environment variables that must be configured
## TBE operator implementation tool path
export TBE_IMPL_PATH=${LOCAL_ASCEND}/ascend-toolkit/latest/opp/op_impl/built-in/ai_core/tbe
## OPP path
export ASCEND_OPP_PATH=${LOCAL_ASCEND}/ascend-toolkit/latest/opp
## AICPU path
export ASCEND_AICPU_PATH=${ASCEND_OPP_PATH}/..
## TBE operator compilation tool path
export PATH=${LOCAL_ASCEND}/ascend-toolkit/latest/compiler/ccec_compiler/bin/:${PATH}
## Python library that TBE implementation depends on
export PYTHONPATH=${TBE_IMPL_PATH}:${PYTHONPATH}

Installation Verification

i:

python -c "import mindspore;mindspore.run_check()"

The output should be like:

MindSpore version: __version__
The result of multiplication calculation is correct, MindSpore has been installed successfully!

It means MindSpore has been installed successfully.

ii:

import numpy as np
import mindspore as ms
import mindspore.ops as ops

ms.set_context(device_target="Ascend")
x = ms.Tensor(np.ones([1,3,3,4]).astype(np.float32))
y = ms.Tensor(np.ones([1,3,3,4]).astype(np.float32))
print(ops.add(x, y))

The outputs should be the same as:

[[[[2. 2. 2. 2.]
   [2. 2. 2. 2.]
   [2. 2. 2. 2.]]

  [[2. 2. 2. 2.]
   [2. 2. 2. 2.]
   [2. 2. 2. 2.]]

  [[2. 2. 2. 2.]
   [2. 2. 2. 2.]
   [2. 2. 2. 2.]]]]

It means MindSpore has been installed successfully.

Version Update

Use the following command if you need to update the MindSpore version:

conda update mindspore-ascend -c mindspore -c conda-forge

Please reinstall .whl packages provided with the Ascend AI Processor software package. First, uninstall old versions:

pip uninstall te topi hccl -y

Then, install again by running:

pip install /usr/local/Ascend/ascend-toolkit/latest/lib64/topi-*-py3-none-any.whl
pip install /usr/local/Ascend/ascend-toolkit/latest/lib64/te-*-py3-none-any.whl
pip install /usr/local/Ascend/ascend-toolkit/latest/lib64/hccl-*-py3-none-any.whl
1
https://gitee.com/mindspore/docs.git
git@gitee.com:mindspore/docs.git
mindspore
docs
docs
r1.9

搜索帮助