mirror of
https://github.com/storytold/storyteller-ml.git
synced 2026-10-09 00:09:55 +00:00
Documentation
This commit is contained in:
@@ -0,0 +1,26 @@
|
||||
storyteller-ml
|
||||
==============
|
||||
The ML models that power FakeYou and other Storyteller functions.
|
||||
|
||||
This repository is in a bit of a rough shape, but should be improving.
|
||||
|
||||
TTS models (Tacotron, HifiGan, WaveGlow, etc.) live under [`tts/`, and you can find documentation there](tts/).
|
||||
|
||||
We expect to add video, posture estimation, phoneme prediction, and other models soon.
|
||||
|
||||
FakeYou Backend Architecture
|
||||
----------------------------
|
||||
We have a Rust monolith that controls the user interface, account system, and all the database CRUD operations.
|
||||
It doesn't do any ML work itself or have any attached GPUs.
|
||||
|
||||
There are a series of worker pods ("jobs") that pull from work queues and run inference, then upload the results.
|
||||
|
||||

|
||||
|
||||
The jobs are written in Rust and either shell out to Python code or call an in-container Python server that attempts
|
||||
to LRU cache models in memory.
|
||||
|
||||

|
||||
|
||||

|
||||
|
||||
Binary file not shown.
|
After Width: | Height: | Size: 79 KiB |
Binary file not shown.
|
After Width: | Height: | Size: 98 KiB |
Binary file not shown.
|
After Width: | Height: | Size: 105 KiB |
@@ -0,0 +1,39 @@
|
||||
local development setup
|
||||
=======================
|
||||
|
||||
Ubuntu 22.04
|
||||
------------
|
||||
|
||||
|
||||
### Install Python
|
||||
|
||||
```bash
|
||||
sudo apt install python3.11-venv
|
||||
```
|
||||
|
||||
### Install Docker
|
||||
|
||||
```bash
|
||||
sudo apt install docker.io
|
||||
|
||||
# Docker requires user group permissions
|
||||
# This may require a logout to work
|
||||
sudo groupadd docker
|
||||
sudo usermod -aG docker ${USER}
|
||||
newgrp docker
|
||||
|
||||
# Test if Docker works
|
||||
docker run hello-world
|
||||
```
|
||||
|
||||
MacOS
|
||||
-----
|
||||
|
||||
(TODO)
|
||||
|
||||
Windows
|
||||
-------
|
||||
|
||||
(Not supported.)
|
||||
|
||||
|
||||
Reference in New Issue
Block a user