# tflite-ethosu-delegate-imx

**Repository Path**: githubmap/tflite-ethosu-delegate-imx

## Basic Information

- **Project Name**: tflite-ethosu-delegate-imx
- **Description**: No description available
- **Primary Language**: Unknown
- **License**: Apache-2.0
- **Default Branch**: lf-6.1.1_1.0.0
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2023-12-01
- **Last Updated**: 2023-12-01

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# TfLite-ethosu-delegate
TfLite-ethosu-delegate is an delegate for tensorflow lite.

# Use tflite-ethosu-delegate

## Prepare source code
```sh
mkdir wksp && cd wksp
git clone https://github.com/nxpmicro/tflite-ethosu-delegate.git
# tensorflow is optional, it will be downloaded automatically if not present
git clone https://github.com/tensorflow/tensorflow.git
```
# Build from source with cmake

```sh
# set the toolchain env
source /PATH_TO_TOOLCHAIN/environment-setup-cortexa53-crypto-poky-linux

# build the delegate
cd tflite-ethosu-delegate
mkdir build && cd build
cmake ..
make -j12

# benchmark_model
make benchmark_model -j12
# label_image
make lable_image -j12
```

If you would like to build using local version of tensorflow, you can use `FETCHCONTENT_SOURCE_DIR_TENSORFLOW` cmake variable. Point this variable to your tensorflow tree. For additional details on this variable please see the [official cmake documentation](https://cmake.org/cmake/help/latest/module/FetchContent.html#command:fetchcontent_populate)

``` sh
cmake -DFETCHCONTENT_SOURCE_DIR_TENSORFLOW=/my/copy/of/tensorflow \
    -DOTHER_CMAKE_DEFINES...\
    ..
```
After cmake execution completes, build and run as usual.

## Enable external delegate support in benchmark_model/label_image

If tensorflow source code downloaded by cmake, you can find it in <build_output_dir>/_deps/tensorflow-src

## Run
```sh
./benchmark_model --external_delegate_path=<patch_to_libethosu_delegate.so> --graph=<tflite_model.tflite>
# If you would like to enable PMU counter
./benchmark_model --external_delegate_path=<patch_to_libethosu_delegate.so> \
                  --external_delegate_options='enable_cycle_counter:true;pmu_event0:3;pmu_event1:4;pmu_event2:5;pmu_event3:6' \
                  --graph=<tflite_model.tflite>
```