Brandon Thomas b50205847c readme/notes
2022-02-28 05:46:37 -05:00
2022-02-28 05:46:37 -05:00
2022-02-28 05:46:37 -05:00
2022-02-28 05:46:37 -05:00

tts-core

The core TTS models that power FakeYou.

I'm in the progress of pulling these out of the service monorepo so we can iterate faster.

TODO

Core cleanup

  • Cleanup Tacotron code
    • Integrate WaveGlow and HifiGan more cleanly
    • Define the HTTP server interface
    • Define the model checking interface
    • Clean up in-memory LRU caching
    • There are two copies of Nemo. Why? Clean this up.
  • Deployability
    • Clean up requirements.txt and upgrade packages
    • Clean up Dockerfile

Make the models sound better

  • Arpabet

    • G2P
    • Arpabet custom dictionary
    • User-supplied Arpabet strings in braces
  • Word break down 888 -> eight hundred eighty eight

  • Support I18N

    • Accent character support

Introduce new models

  • TalkNet
  • GlowTTS + MelGan (vocoder)
  • Make these work under the same venv

Lots more I haven't covered yet...

S
Description
Tacotron core, eventually with more models
Readme 2.9 GiB
Languages
Jupyter Notebook 66%
Python 28.1%
C++ 4.5%
C 0.4%
Shell 0.4%
Other 0.3%