Update README. Root-level readme is going to go out of date

Since the root readme can't give us much information on each model,
we'll just add some ASCII art.
This commit is contained in:
Brandon Thomas
2023-03-13 04:26:27 -04:00
parent 9fe76017d4
commit c4ec6ffc08
4 changed files with 118 additions and 74 deletions
+26
View File
@@ -0,0 +1,26 @@
storyteller-ml
==============
The ML models that power FakeYou and other Storyteller functions.
This repository is in a bit of a rough shape, but should be improving.
TTS models (Tacotron, HifiGan, WaveGlow, etc.) live under [`tts/`, and you can find documentation there](tts/).
We expect to add video, posture estimation, phoneme prediction, and other models soon.
FakeYou Backend Architecture
----------------------------
We have a Rust monolith that controls the user interface, account system, and all the database CRUD operations.
It doesn't do any ML work itself or have any attached GPUs.
There are a series of worker pods ("jobs") that pull from work queues and run inference, then upload the results.
![](./diagrams/microservices.png)
The jobs are written in Rust and either shell out to Python code or call an in-container Python server that attempts
to LRU cache models in memory.
![](./diagrams/jobs1.png)
![](./diagrams/jobs2.png)