# AlphaGAN-Matting
**Repository Path**: trichoderma-flavum/AlphaGAN-Matting
## Basic Information
- **Project Name**: AlphaGAN-Matting
- **Description**: This project is an unofficial implementation of AlphaGAN: Generative adversarial networks for natural image matting published at the BMVC 2018
- **Primary Language**: Unknown
- **License**: Not specified
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No
## Statistics
- **Stars**: 0
- **Forks**: 0
- **Created**: 2021-02-18
- **Last Updated**: 2021-06-24
## Categories & Tags
**Categories**: Uncategorized
**Tags**: None
## README
# AlphaGAN
    
This project is an unofficial implementation of [AlphaGAN: Generative adversarial networks for natural image matting](https://arxiv.org/pdf/1807.10088.pdf) published at the BMVC 2018. As for now, the result of my experiment is not as good as the paper's.
# Dataset
## Adobe Deep Image Matting Dataset
Follow the [instruction](https://sites.google.com/view/deepimagematting) to contact the author for the dataset
You might need to follow the method mentioned in the **Deep Image Matting** to generate the trimap using the alpha mat.
The trimap are generated while the data are loaded.
```python
import numpy as np
import cv2 as cv
def generate_trimap(alpha):
k_size = random.choice(range(2, 5))
iterations = np.random.randint(5, 15)
kernel = cv.getStructuringElement(cv.MORPH_ELLIPSE, (k_size, k_size))
dilated = cv.dilate(alpha, kernel, iterations=iterations)
eroded = cv.erode(alpha, kernel, iterations=iterations)
trimap = np.zeros(alpha.shape, dtype=np.uint8)
trimap.fill(128)
trimap[eroded >= 255] = 255
trimap[dilated <= 0] = 0
return trimap
```
See `scripts/MattingTrain.ipynb` and `scripts/MattingTest.ipynb` to compose the training/testing set.
The Dataset structure in my project
```Bash
Train
├── alpha # the alpha ground-truth
├── fg # the foreground image
├── merged_cv # the real image composed by the fg & bg
MSCOCO
├── train2014 # the background image
```
# Running the Codes
```shell
python train.py --dataroot ${YOUR_DIM_DATASET_ROOT} \
--training_file ${THE TRAINING FILE OF THE DIM DATASET}
```
# Differences from the original paper
- SyncBatchNorm instead of pytorch original BatchNorm when use multi GPU.
- Training batch_size = 1 [[1]](#ref1) [[2]](#ref2)
- Using GroupNorm [[2]](#ref2)
- Using Warmup [[3]](#ref3) [[4]](#ref4)
# Records
4 GPUS 32 batch size, and SyncBatchNorm
- Achieved **SAD=78.22** after 21 epoches.
1 GPU 1 batch size, and GroupNorm
- Achieved [**SAD=68.61 MSE=0.03189**](https://drive.google.com/open?id=1yFRSjTNlAycmio8B-aibR7ZfYB9oZ-H3) after 33 epoches.
- Achieved [**SAD=61.9 MSE=0.02878**](https://drive.google.com/open?id=1mICVWsQYGz3FrwiVZCnhsp56OAh-9coS) after xx epoches.
# Results
| image | trimap | alpha(predicted) |
|:---: | :--: | :---: |
|| | |
|| | |
||||
||||
||||
# Acknowledgments
My code is inspired by:
- [1] [pytorch-deep-image-matting](https://github.com/huochaitiantang/pytorch-deep-image-matting)
- [2] [FBA-Matting](https://github.com/MarcoForte/FBA-Matting)
- [3] [GCA-Matting](https://github.com/MarcoForte/FBA-Matting)
- [4] [reid-strong-baseline](https://github.com/michuanhaohao/reid-strong-baseline)
- [pytorch-CycleGAN-and-pix2pix](https://github.com/junyanz/pytorch-CycleGAN-and-pix2pix)
- [pytorch-book](https://github.com/chenyuntc/pytorch-book) chapter7 generate anime head portrait with GAN
- [pytorch-deeplab-xception](https://github.com/jfzhang95/pytorch-deeplab-xception)
- [indexnet_matting](https://github.com/poppinace/indexnet_matting)