Introduce code from Rust monorepo. This is a mess

This commit is contained in:
Brandon Thomas
2022-02-28 05:43:54 -05:00
parent 921fb49f9a
commit ba326bfcfd
1058 changed files with 192192 additions and 0 deletions
+39
View File
@@ -0,0 +1,39 @@
Common Collection
=================
The common collection contains things that could be used across all collections.
Tokenizers
----------
.. automodule:: nemo.collections.common.tokenizers.AutoTokenizer
:special-members: __init__
.. automodule:: nemo.collections.common.tokenizers.SentencePieceTokenizer
:special-members: __init__
.. automodule:: nemo.collections.common.tokenizers.TokenizerSpec
:special-members: __init__
Losses
------
.. automodule:: nemo.collections.common.losses.AggregatorLoss
:special-members: __init__
.. automodule:: nemo.collections.common.losses.CrossEntropyLoss
:special-members: __init__
.. automodule:: nemo.collections.common.losses.MSELoss
:special-members: __init__
.. automodule:: nemo.collections.common.losses.SmoothedCrossEntropyLoss
:special-members: __init__
.. automodule:: nemo.collections.common.losses.SpanningLoss
:special-members: __init__
Metrics
-------
.. autoclass:: nemo.collections.common.metrics.Perplexity
:show-inheritance:
:members:
:undoc-members: