# VideoStitchingViaShakinessRemoving

**Repository Path**: changjy/VideoStitchingViaShakinessRemoving

## Basic Information

- **Project Name**: VideoStitchingViaShakinessRemoving
- **Description**: Demo code for our TIP video stitching paper in 2017
- **Primary Language**: Matlab
- **License**: BSD-2-Clause
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2019-09-03
- **Last Updated**: 2020-12-19

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# Dynamic Video Stitching via Shakiness Removing

Demo code for the works below:
 - Nie, Yongwei, et al. "[Dynamic Video Stitching via Shakiness Removing](http:://ieeexplore.ieee.org/document/8003352/)." IEEE Transactions on Image Processing 27.1 (2018): 164-178.
 - Su, Tan, et al. "[Video stitching for handheld inputs via combined video stabilization](https://dl.acm.org/citation.cfm?id=3005383)." SIGGRAPH ASIA 2016 Technical Briefs. ACM, 2016.

[Video Demo](https://youtu.be/IDzFvqRb40Y) on YouTube:

[![Video Demo](https://img.youtube.com/vi/IDzFvqRb40Y/0.jpg)](https://youtu.be/IDzFvqRb40Y) 

## Dataset
___Including video clips from previous works, see Readme.MD for more details)___

[Google Drive Link](https://drive.google.com/drive/folders/11ybVIQCOj-ojEYLvW85ZtqI4I_8Zd9lI?usp=sharing) 
[BaiduYun](https://pan.baidu.com/s/1bZd1k6#list/path=%2F)


## External libraries and code used:
 - Shankar Rao's Motion Segmentation Code: http://perception.csl.illinois.edu/coding/motion/#Software
 - CVX: http://cvxr.com/cvx/
 - vlfeat: http://www.vlfeat.org/
 - peter kovesi matlab toolbox: http://www.peterkovesi.com/matlabfns/
 - Liu Shuaicheng's As-similar-as-possible Warping code: http://www.liushuaicheng.org/SIGGRAPH2013/index.htm
 
## How to use this demo code:

1. In the folder `/case-cuhk_lib`, extract video frames of ***case17-l.mp4*** to folder `/left`, and extract video frames of ***case17-r.mp4*** to folder `/right`. After the frame extracation, each folder should contain 400 png files. The file names should be indexed properly. (e.g. ***001.png 002.png*** ...)

2. You may need to install `CVX` if you have not. 

3. Set MATLAB path to `/Stitching-1.1.0`, run `RunStitching.m`. The generated output frames will be in the auto-created subfolder under `/case-cuhk_lib`. (`res_demo` if you didn't change the output path). 

4. Build the OpenCV project in `/SeamCut` (You need to set OpenCV's include and library path manually) and copy the executable (e.g. `SeamCut.exe`) to the folder containing the output frames (***1.png***, ***A1.png***, ***B1.png***, ***2.png***, ***A2.png***, ***B2.png***, ...). This program finds the continuous optimal seam by GraphCut algorithm and use OpenCV's multi-band blending function. 

5. Run `./SeamCut 5 1 400 1 0.2` to see the final result. Blended frames are saved as ***D1.png***, ***D2.png***, ...

For more details, please read the comments

## Please cite our papers:

@article{nie2018dynamic,
  title={Dynamic Video Stitching via Shakiness Removing},
  author={Nie, Yongwei and Su, Tan and Zhang, Zhensong and Sun, Hanqiu and Li, Guiqing},
  journal={IEEE Transactions on Image Processing},
  volume={27},
  number={1},
  pages={164--178},
  year={2018},
  publisher={IEEE}
}

@inproceedings{su2016video,
  title={Video stitching for handheld inputs via combined video stabilization},
  author={Su, Tan and Nie, Yongwei and Zhang, Zhensong and Sun, Hanqiu and Li, Guiqing},
  booktitle={SIGGRAPH ASIA 2016 Technical Briefs},
  pages={25},
  year={2016},
  organization={ACM}
}
 
Code by Tan Su, Zhensong Zhang and Yongwei Nie. For research purpose ONLY. 
[![996.icu](https://img.shields.io/badge/link-996.icu-red.svg)](https://996.icu)