# JAT-mindspore

**Repository Path**: MountVoom/jat-mindspore

## Basic Information

- **Project Name**: JAT-mindspore
- **Description**: JAT-mindspore
- **Primary Language**: Python
- **License**: Apache-2.0
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2024-03-03
- **Last Updated**: 2024-03-05

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# JAT-mindspore

#### 介绍

Jump Self-attention: Capturing High-order Statistics in Transformers (NIPS 2022)

#### 运行

训练：

``python run.py --run_mode finetune``

测试：

`python run.py --run_mode eval`

运行过程截图如下：

![s](figs/pic.png)