# Total-Text-Dataset

**Repository Path**: reatris/Total-Text-Dataset

## Basic Information

- **Project Name**: Total-Text-Dataset
- **Description**: Total Text Dataset. It consists of 1555 images with more than 3 different text orientations: Horizontal, Multi-Oriented, and Curved, one of a kind.
- **Primary Language**: Unknown
- **License**: BSD-3-Clause
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2020-01-31
- **Last Updated**: 2020-12-19

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# Total-Text-Dataset (Official site)

Updated on Sept. 08, 2019 (New [training groundtruths](https://github.com/cs-chan/Total-Text-Dataset/tree/master/Groundtruth/Text) of Total-Text is now available)

Updated on Sept. 07, 2019 - (Updated [Guided Annotation toolbox](https://github.com/cs-chan/Total-Text-Dataset/tree/master/Annotation_tools) for scene text image annotation)

Updated on Sept. 07, 2019 (Updated [baseline](https://github.com/cs-chan/Total-Text-Dataset/tree/master/Baseline) as to our IJDAR)

Updated on August 01, 2019 (Extended version with new baseline + annotation tool is accepted at [IJDAR](https://link.springer.com/article/10.1007/s10032-019-00334-z))

Updated on May 30, 2019 (Important announcement on Total-Text vs. ArT dataset)

Updated on April 02, 2019 (Updated table ranking with default vs. our proposed DetEval)

Updated on March 31, 2019 (Faster version DetEval.py, support Python3. Thank you [princewang1994](https://github.com/princewang1994).)

Updated on March 14, 2019 (Updated table ranking with evaluation protocol info.)

Updated on November 26, 2018 (Table ranking is included for reference.)

Updated on August 24, 2018 (Newly added [Guided Annotation toolbox](https://github.com/cs-chan/Total-Text-Dataset/tree/master/Annotation_tools) folder.)

Updated on May 15, 2018 (Added groundtruth in '.txt' format.)

Updated on May 14, 2018 (Added feature - 'Do not care' candidates filtering is now available in the latest python scripts.)

Updated on April 03, 2018 (Added pixel level groundtruth)

Updated on November 04, 2017 (Added text level groundtruth)

Released on October 27, 2017

# News

TOTAL-TEXT is a word-level based English curve text dataset. If you are interested in text-line based dataset with both English and Chinese instances, we highly recommend you to refer [SCUT-CTW1500](https://github.com/Yuliang-Liu/Curve-Text-Detector). In addition, a Robust Reading Challenge on Arbitrary-Shaped Text ([RRC-ArT](http://rrc.cvc.uab.es/?ch=14)), which is extended from Total-Text and SCUT-CTW1500, was held at ICDAR2019 to stimulate more innovative ideas on the arbitrary-shaped text reading task. Congratulations to all winners and challengers. The technical report of ArT can be found on at [this https URL](https://arxiv.org/abs/1909.07145).

# Important Announcement
Total-Text and SCUT-CTW1500 are now part of the training set of the largest curved text dataset - [ArT (Arbitrary-Shaped Text dataset)](http://rrc.cvc.uab.es/?ch=14). In order to retain the validity of future benchmarking on Total-Text datasets, the **test-set images** of Total-Text should be removed (with the corresponding ID provided [HERE](https://github.com/cs-chan/Total-Text-Dataset/blob/master/Total_Text_ID_vs_ArT_ID.list)) from the ArT dataset shall one intend to leverage the extra training data from the ArT dataset. We count on the trust of the research community to perform such removal operation to attain the fairness of the benchmarking.

## Table Ranking

- The results from recent papers on Total-Text dataset are listed below where P=Precision, R=Recall & F=F-score.
- If your result is missing or incorrect, please do not hesisate to contact us.
- <sup>*</sup>Pascal VOC IoU metric; <a href="https://arxiv.org/abs/1712.02170"><sup>**</sup>Polygon Regression</a>

### Detection
<table>
    <thead align="center">
       <tr>
           <th rowspan=2>Method</th>
           <th colspan=3>Reported <br>on paper</th>
           <th colspan=3>DetEval <br> (tp=0.4, tr=0.8) <br>(Default)</th>
           <th colspan=3>DetEval <br>(tp=0.6, tr=0.7) <br>(New Proposal) </th>
           <th rowspan=2>Published at</th>
        </tr>
        <tr>
            <th>P</th>
            <th>R</th>
            <th>F</th>
            <th>P</th>
            <th>R</th>
            <th>F</th>
            <th>P</th>
            <th>R</th>
            <th>F</th>
        </tr>
    </thead>
    <tbody align="center">
        <tr>
           <td><sup>3</sup>Baseline <a href="http://cs-chan.com/doc/IJDAR2019.pdf">[paper]</a></td>
           <td>78.0</td>
           <td>68.0</td>
           <td>73.0</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>78.0</td>
           <td>68.0</td>
           <td>73.0</td>
           <td>IJDAR2019</td>
        </tr>
        <tr>
           <td>Boundary (E2E) <a href="https://arxiv.org/abs/1911.09550">[paper]</a></td>
           <td>88.9</td>
           <td>85.0</td>
           <td>87.0</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>AAAI2020</td>
        </tr>
        <tr>
           <td>CharNet H-88 MS <a href="https://arxiv.org/abs/1910.07954">[paper]</a></td>
           <td>88.0</td>
           <td>85.0</td>
           <td>86.5</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>ICCV2019</td>
        </tr>
        <tr>
           <td>DB-ResNet50 (800) <a href="https://arxiv.org/abs/1911.08947">[paper]</a></td>
           <td>87.1</td>
           <td>82.5</td>
           <td>84.7</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>AAAI2020</td>
        </tr>
        <tr>
           <td>TextCohesion <a href="https://arxiv.org/abs/1904.12640">[paper]</a></td>
           <td>88.1</td>
           <td>81.4</td>
           <td>84.6</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>arXiv:1904</td>
        </tr>
        <tr>
           <td>CRAFT <a href="https://arxiv.org/abs/1904.01941">[paper]</a></td>
           <td>87.6</td>
           <td>79.9</td>
           <td>83.6</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>CVPR2019</td>
        </tr>
        <tr>
           <td>LOMO MS <a href="https://arxiv.org/abs/1904.06535">[paper]</a></td>
           <td>87.6</td>
           <td>79.3</td>
           <td>83.3</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>CVPR2019</td>
        </tr>
        <tr>
           <td>ICG <a href="https://www.sciencedirect.com/science/article/abs/pii/S0031320319302511">[paper]</a></td>
           <td>82.1</td>
           <td>80.9</td>
           <td>81.5</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>PR2019</td>
        </tr>
        <tr>
           <td>FTSN <a href="https://arxiv.org/abs/1709.03272">[paper]</a></td>
           <td><sup>*</sup>84.7</td>
           <td><sup>*</sup>78.0</td>
           <td><sup>*</sup>81.3</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>ICPR2018</td>
        </tr> 
        <tr>
           <td>PSENet-1s <a href="https://arxiv.org/abs/1903.12473">[paper]</a></td>
           <td>84.02</td>
           <td>77.96</td>
           <td>80.87</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>CVPR2019</td>
        </tr>
        <tr>
            <td><sup>1</sup>TextField <a href="https://arxiv.org/abs/1812.01393">[paper]</a></td>
           <td>81.2</td>
           <td>79.9</td>
           <td>80.6</td>
           <td>76.1</td>
           <td>75.1</td>
           <td>75.6</td>
           <td>83.0</td>
           <td>82.0</td>
           <td>82.5</td>
           <td>TIP2019</td>
        </tr>
        <tr>
           <td>CSE <a href="https://arxiv.org/abs/1903.08836">[paper]</a></td>
           <td>81.4<br>(<sup>**</sup>80.9)</td>
           <td>79.7<br>(<sup>**</sup>80.3)</td>
           <td>80.2<br>(<sup>**</sup>80.6)</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>CVPR2019</td>
        </tr>
        <tr>
           <td>MSR <a href="https://arxiv.org/abs/1901.02596">[paper]</a></td>
           <td>85.2</td>
           <td>73.0</td>
           <td>78.6</td>
           <td>82.7</td>
           <td>68.3</td>
           <td>74.9</td>
           <td>81.4</td>
           <td>72.5</td>
           <td>76.7</td>
           <td>arXiv:1901</td>
        </tr>
        <tr>
           <td>ATTR <a href="http://openaccess.thecvf.com/content_CVPR_2019/papers/Wang_Arbitrary_Shape_Scene_Text_Detection_With_Adaptive_Text_Region_Representation_CVPR_2019_paper.pdf">[paper]</a></td>
           <td>80.9</td>
           <td>76.2</td>
           <td>78.5</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>CVPR2019</td>
        </tr>
        <tr>
           <td>TextSnake <a href="http://openaccess.thecvf.com/content_ECCV_2018/papers/Shangbang_Long_TextSnake_A_Flexible_ECCV_2018_paper.pdf">[paper]</a></td>
           <td>82.7</td>
           <td>74.5</td>
           <td>78.4</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>ECCV2018</td>
        </tr>
        <tr>
           <td><sup>1</sup>CTD <a href="https://www.sciencedirect.com/science/article/pii/S0031320319300664">[paper]</a></td>
           <td>74.0</td>
           <td>71.0</td>
           <td>73.0</td>
           <td>60.7</td>
           <td>58.8</td>
           <td>59.8</td>
           <td>76.5</td>
           <td>73.8</td>
           <td>75.2</td>
           <td>PR2019</td>
        </tr>
        <tr>
           <td>TextNet <a href="https://arxiv.org/abs/1812.09900">[paper]</a></td>
           <td>68.2</td>
           <td>59.5</td>
           <td>63.5</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>ACCV2018</td>
        </tr>
        <tr>
           <td><sup>2</sup>Mask TextSpotter <a href="http://openaccess.thecvf.com/content_ECCV_2018/papers/Pengyuan_Lyu_Mask_TextSpotter_An_ECCV_2018_paper.pdf">[paper]</a></td>
           <td>69.0</td>
           <td>55.0</td>
           <td>61.3</td>
           <td>68.9</td>
           <td>62.5</td>
           <td>65.5</td>
           <td>82.5</td>
           <td>75.2</td>
           <td>78.6</td>
           <td>ECCV2018</td>
        </tr>
        <tr>
           <td>CENet <a href="https://arxiv.org/abs/1901.00363">[paper]</a></td>
           <td>59.9</td>
           <td>54.4</td>
           <td>57.0</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>ACCV2018</td>
        </tr>
        <tr>
           <td>Textboxes <a href="https://arxiv.org/abs/1611.06779">[paper]</a></td>
           <td>62.1</td>
           <td>45.5</td>
           <td>52.5</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>AAAI2017</td>
        </tr>
        <tr>
           <td>EAST <a href="https://arxiv.org/abs/1704.03155">[paper]</a></td>
           <td>50.0</td>
           <td>36.2</td>
           <td>42.0</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>CVPR2017</td>
        </tr>
        <tr>
           <td>SegLink <a href="https://arxiv.org/abs/1703.06520">[paper]</a></td>
           <td>30.3</td>
           <td>23.8</td>
           <td>26.7</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>-</td>
           <td>CVPR2017</td>
        </tr>
    </tbody>
</table>

Note:

<sup>1</sup>For the results of TextField and CTD, the improved versions of their original paper were used, and this explains why the performance is better.

<sup>2</sup>For Mask-TextSpotter, the relatively poor performance reported in their paper was due to a bug in the input reading module (which was fixed recently). The authors were informed about this issue.

<sup>3</sup>The new baseline scores are based on Poly-FRCNN-3 in [this folder](https://github.com/cs-chan/Total-Text-Dataset/tree/master/Baseline).

### End-to-end Recognition <br> (None refers to recognition without any lexicon; Full lexicon contains all words in test set.)
| Method     |  None (%)  |  Full (%)  |   Published at    |
|:--------:  | :-----:   | :----:      |    :-----:    |
|CharNet H-88 MS [[paper]](https://arxiv.org/abs/1910.07954) | 69.2  |  -     |         ICCV2019 |
|Boundary (E2E) [[paper]](https://arxiv.org/abs/1911.09550) | 65.0  |  76.1     |         AAAI2020 |
|TextNet [[paper]](https://arxiv.org/abs/1812.09900)     | 54.0     |  -    |      ACCV2018         |
|Mask TextSpotter [[paper]](http://openaccess.thecvf.com/content_ECCV_2018/papers/Pengyuan_Lyu_Mask_TextSpotter_An_ECCV_2018_paper.pdf)  | 52.9     |  71.8      |    ECCV2018          |
|Textboxes [[paper]](https://arxiv.org/abs/1611.06779)        | 36.3     |  48.9       |         AAAI2017    |




## Description

In order to facilitate a new text detection research, we introduce Total-Text dataset [(IJDAR)](http://cs-chan.com/doc/IJDAR2019.pdf)[(ICDAR-17 paper)](https://arxiv.org/abs/1710.10400) [(presentation slides)](http://cs-chan.com/doc/TT_Slide.pdf), which is more comprehensive than the existing text datasets. The Total-Text consists of 1555 images with more than 3 different text orientations: Horizontal, Multi-Oriented, and Curved, one of a kind.

<img src="ttstatistics.png" width="100%">
<img src="ICDAR17.gif" width="50%">

## Citation
If you find this dataset useful for your research, please cite
```
@article{CK2019,
  author    = {Chee Kheng Ch’ng and
               Chee Seng Chan and
               Chenglin Liu},
  title     = {Total-Text: Towards Orientation Robustness in Scene Text Detection},
  journal   = {IJDAR},
  year      = {2019},
  doi       = {10.1007/s10032-019-00334-z},
}

@inproceedings{CK2017,
  author    = {Chee Kheng Ch’ng and
               Chee Seng Chan},
  title     = {Total-Text: A Comprehensive Dataset for Scene Text Detection and Recognition},
  booktitle = {14th IAPR International Conference on Document Analysis and Recognition {ICDAR}},
  pages     = {935--942},
  year      = {2017},
  doi       = {10.1109/ICDAR.2017.157},
}
```

## Feedback
Suggestions and opinions of this dataset (both positive and negative) are greatly welcome. Please contact the authors by sending email to
`chngcheekheng at gmail.com` or `cs.chan at um.edu.my`.

## License and Copyright
The project is open source under BSD-3 license (see the ``` LICENSE ``` file). Codes can be used freely only for academic purpose.

&#169;2017-2019 Center of Image and Signal Processing, Faculty of Computer Science and Information Technology, University of Malaya.