# stream-vc

**Repository Path**: zyz0577/stream-vc

## Basic Information

- **Project Name**: stream-vc
- **Description**: No description available
- **Primary Language**: Unknown
- **License**: Not specified
- **Default Branch**: main
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2024-07-04
- **Last Updated**: 2024-07-10

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

<div align="center">

# [WIP] StreamVC (Real-Time Low-Latency Voice Conversion)

<a href="https://pytorch.org/get-started/locally/"><img alt="PyTorch" src="https://img.shields.io/badge/PyTorch-ee4c2c?logo=pytorch&logoColor=white"></a>
<a href="https://pytorchlightning.ai/"><img alt="Lightning" src="https://img.shields.io/badge/-Lightning-792ee5?logo=pytorchlightning&logoColor=white"></a>
<a href="https://hydra.cc/"><img alt="Config: Hydra" src="https://img.shields.io/badge/Config-Hydra-89b8cd"></a>
<a href="https://github.com/ashleve/lightning-hydra-template"><img alt="Template" src="https://img.shields.io/badge/-Lightning--Hydra--Template-017F2F?style=flat&logo=github&labelColor=gray"></a><br>
[![Paper](http://img.shields.io/badge/paper-arxiv.1001.2234-B31B1B.svg)](https://arxiv.org/abs/2401.03078)
[![Conference](https://img.shields.io/badge/ICASSP-2024-4b44ce.svg)](https://cmsworkshops.com/ICASSP2024/papers/accepted_papers.php)

</div>

## Description

An unofficial PyTorch implementation of Google's StreamVC.
![Architecture](imgs/architecture.png)

## Installation

#### Pip

```bash
# clone project
git clone https://github.com/hrnoh24/stream-vc.git
cd stream-vc

# [OPTIONAL] create conda environment
conda create -n streamvc python=3.10
conda activate streamvc

# install pytorch according to instructions
# https://pytorch.org/get-started/

# install requirements
pip install -r requirements.txt
```

## How to run

Train model with default configuration

```bash
# train on CPU
python src/train.py trainer=cpu

# train on GPU
python src/train.py trainer=gpu
```

Train model with chosen experiment configuration from [configs/experiment/](configs/experiment/)

```bash
python src/train.py experiment=experiment_name.yaml
```

You can override any parameter from command line like this

```bash
python src/train.py trainer.max_epochs=20 data.batch_size=64
```

## Reference

https://github.com/lucidrains/audiolm-pytorch/tree/main  
https://github.com/facebookresearch/encodec/tree/main  
https://github.com/jaywalnut310/vits/tree/main