Entirely reworked text handling pipeline

This breaks the text pipeline into the following pieces:

- input parsing (split known bracketed phoneme sections out first)

- normalization (fix spacing, numbers, abbreviations, etc.)

- phonetization (do CMUdict lookup or g2p prediction)

- sequencing (convert the symbolic representation to integer
  representation)

Each "pipeline" can have a unique combination of operations for each of
these pipeline steps.

This will grow over time.
This commit is contained in:
Brandon Thomas
2022-06-28 03:25:02 -04:00
parent 6a43c8d7ca
commit 76c6dbf12b
33 changed files with 135390 additions and 1 deletions
+39
View File
@@ -0,0 +1,39 @@
{
"include": [
"text/"
],
"exclude": [
".git/",
"**/*test_*.py",
"**/node_modules",
"**/__pycache__",
"NeMo/",
"hifi-gan/",
"hifigan/",
"nemo/",
"phonetics",
"python/",
"tacotron2/",
"temp/",
"waveglow/"
],
"ignore": [
"tacotron2/",
"**/*test_*.py"
],
"defineConstant": {
},
"venvPath": "python/",
"reportMissingImports": true,
"reportMissingTypeStubs": true,
"pythonVersion": "3.6",
"pythonPlatform": "Linux",
"typeCheckingMode": "strict"
}