README.md · xn1997/TensorRT-Question

## environment

> CUDA11.0
> cudnn8.0.1
> TensorRT7.2.1.6
>
> CMake3.16
> OPENCV4.4

**python**

> torch=1.6
> numpy=1.18

## Add Custom Einsum Plugin

1. Copy the `Einsum` folder and `CMakeLists.txt` to `TensorRT/plugin/`

2. Compile according to `TensorRT/README.md`

3. Copy `TensorRT/build/out/libnvinfer_plugin.so.7.2.1.so` to `${Your_TensorRT_Path}/TensorRT-7.2.1.6/lib/`

```shell
   cp TensorRT/build/out/libnvinfer_plugin.so.7.2.1.so ${Your_TensorRT_Path}/TensorRT-7.2.1.6/lib/
   ```

## Problems recur

1. Enter the `sample` folder

```shell
   cd sample
   ```

2. Generate `gcn.onnx`

```shell
   python generate_onnx.py
   ```

3. Modify`sample/CMakeLists.txt`

```cmake
   include_directories(${Your_TensorRT_Path}/TensorRT-7.2.1.6/include/)
   file(GLOB_RECURSE trtlib ${Your_TensorRT_Path}/TensorRT-7.2.1.6/lib/*.so)
   set(OpenCV_DIR "/usr/local/opencv4.4.0/lib/cmake/opencv4")
   ```

4. Compiling test samples

```sh
   cd sample
   mkdir -p build && cd build
   cmake ..
   ```

5. Running test samples

```shell
   cd ../bin
   ./onnx2trt_gcn
   ```

You will get the following output (this result is wrong)

![image-20210616173324222](https://gitee.com/xn1997/picgo/raw/master/image-20210616173324222.png)

The correct output should be the following figure![image-20210616174340723](https://gitee.com/xn1997/picgo/raw/master/image-20210616174340723.png)

It seems that the data read by the op has changed.  **The input of the plugin should be a matrix of all 1, but actually there are many 0's. I don't know what's wrong with the custom implementation of the plugin**

## About trtexec

I compiled `trtexec` as follows

```
cd <TensorRT root directory>/samples/trtexec
make
```

But when I execute the following command

```
./trtexec --onnx=gcn.onnx
```

The following error occurred

![image-20210616180940589](https://gitee.com/xn1997/picgo/raw/master/image-20210616180940589.png)

**It seems that I didn't detect the plugin I implemented. I didn't find out what the problem was???**

xn1997/TensorRT-Question

简介

发行版

贡献者

语言

近期动态

xn1997/TensorRT-Question .gitee-modal { width: 500px !important; }

简介

发行版

贡献者

语言

近期动态

搜索帮助

xn1997/TensorRT-Question