mirror of
https://github.com/storytold/storyteller-ml.git
synced 2026-10-17 00:23:14 +00:00
Brandon Thomas
27 lines
1.4 KiB
Markdown
27 lines
1.4 KiB
Markdown
# Controllable TalkNet
|
|
Controllable TalkNet is a web application that lets you synthesize speech,
|
|
which mimics the pitch and pacing of an existing audio clip. It's based on [NVIDIA's implementation](https://github.com/NVIDIA/NeMo)
|
|
of TalkNet 2, with some changes to support singing synthesis and higher audio quality.
|
|
|
|
## Requirements
|
|
* A Google account to run Colab, or...
|
|
* An NVIDIA GPU with 4+ GB of VRAM
|
|
* 10 GB of free space
|
|
|
|
## How to run
|
|
### Google Colab
|
|
* [Go to the Colab notebook](https://colab.research.google.com/drive/1aj6Jk8cpRw7SsN3JSYCv57CrR6s0gYPB) and follow the instructions.
|
|
|
|
### TalkNet Offline (Windows)
|
|
* [Download the setup script](https://github.com/SortAnon/ControllableTalkNet/releases/latest/download/TalkNetOffline.zip)
|
|
and extract it to a folder.
|
|
* Run setup.bat. The initial setup will take about 20 minutes.
|
|
* When it's done, run talknet.bat to start TalkNet on http://127.0.0.1:8050/. To download updates, run update.bat.
|
|
|
|
### Docker (Linux)
|
|
* Install Docker and NVIDIA Container Toolkit.
|
|
* [Download the Dockerfile.](https://raw.githubusercontent.com/SortAnon/ControllableTalkNet/main/Dockerfile)
|
|
Open a terminal, and navigate to the directory where you saved it.
|
|
* Run ```docker build -t talknet-offline .``` to build the image. Add ```sudo``` if you're not using rootless Docker.
|
|
* Run ```docker run -it --gpus all -p 8050:8050 talknet-offline``` to start TalkNet on http://127.0.0.1:8050/.
|