109 Star 871 Fork 1.5K

MindSpore/models

Create your Gitee Account
Explore and code with more than 13.5 million developers,Free private repositories !:)
Sign up
文件
Clone or Download
contribute
Sync branch
Cancel
Notice: Creating folder will generate an empty file .keep, because not support in Git
Loading...
README

Contents

TINY-SAM Description

We first propose a full-stage knowledge distillation method with online hard prompt sampling strategy to distill a lightweight student model. We also adapt the post-training quantization to the promptable segmentation task and further reducing the computational cost. Moreover, a hierarchical segmenting everything strategy is proposed to accelerate the everything inference by with almost no performance degradation. With all these proposed methods, our TinySAM leads to orders of magnitude computational reduction and pushes the envelope for efficient segment anything task. Extensive experiments on various zero-shot transfer tasks demonstrate the significantly advantageous performance of our TinySAM against counterpart methods.

Framework

The proposed framework and zero-shot instance segmentation results are shown below:

tinysam

Environment Requirements

Script description

Script and sample code


SNN-MLP
├── demo.py # demo entry
├── fig
│   ├── picture1.jpg # demo picture
│   └── tinysam.png # the illustration of the framework of tinysam
├── README.md # Readme
└── tinysam # source code of tinySAM

Eval process

Usage

After installing MindSpore via the official website, you can start evaluation as follows:

Download

Download ckpts from modelzoo.

Launch


# infer example
  python demo.py #CPU

ModelZoo Homepage

Please check the official homepage.

马建仓 AI 助手
尝试更多
代码解读
代码找茬
代码优化
1
https://gitee.com/mindspore/models.git
git@gitee.com:mindspore/models.git
mindspore
models
models
master

Search