mirror of
https://github.com/storytold/storyteller-ml.git
synced 2026-10-11 21:41:18 +00:00
Brandon Thomas
c4ec6ffc08
Since the root readme can't give us much information on each model, we'll just add some ASCII art.
27 lines
956 B
Markdown
27 lines
956 B
Markdown
storyteller-ml
|
|
==============
|
|
The ML models that power FakeYou and other Storyteller functions.
|
|
|
|
This repository is in a bit of a rough shape, but should be improving.
|
|
|
|
TTS models (Tacotron, HifiGan, WaveGlow, etc.) live under [`tts/`, and you can find documentation there](tts/).
|
|
|
|
We expect to add video, posture estimation, phoneme prediction, and other models soon.
|
|
|
|
FakeYou Backend Architecture
|
|
----------------------------
|
|
We have a Rust monolith that controls the user interface, account system, and all the database CRUD operations.
|
|
It doesn't do any ML work itself or have any attached GPUs.
|
|
|
|
There are a series of worker pods ("jobs") that pull from work queues and run inference, then upload the results.
|
|
|
|
|
|
|
|
The jobs are written in Rust and either shell out to Python code or call an in-container Python server that attempts
|
|
to LRU cache models in memory.
|
|
|
|
|
|
|
|
|
|
|