mirror of
https://github.com/storytold/storyteller-ml.git
synced 2026-10-16 00:13:07 +00:00
Introduce code from Rust monorepo. This is a mess
This commit is contained in:
@@ -0,0 +1,39 @@
|
||||
Common Collection
|
||||
=================
|
||||
|
||||
The common collection contains things that could be used across all collections.
|
||||
|
||||
Tokenizers
|
||||
----------
|
||||
.. automodule:: nemo.collections.common.tokenizers.AutoTokenizer
|
||||
:special-members: __init__
|
||||
.. automodule:: nemo.collections.common.tokenizers.SentencePieceTokenizer
|
||||
:special-members: __init__
|
||||
.. automodule:: nemo.collections.common.tokenizers.TokenizerSpec
|
||||
:special-members: __init__
|
||||
|
||||
|
||||
Losses
|
||||
------
|
||||
.. automodule:: nemo.collections.common.losses.AggregatorLoss
|
||||
:special-members: __init__
|
||||
|
||||
.. automodule:: nemo.collections.common.losses.CrossEntropyLoss
|
||||
:special-members: __init__
|
||||
|
||||
.. automodule:: nemo.collections.common.losses.MSELoss
|
||||
:special-members: __init__
|
||||
|
||||
.. automodule:: nemo.collections.common.losses.SmoothedCrossEntropyLoss
|
||||
:special-members: __init__
|
||||
.. automodule:: nemo.collections.common.losses.SpanningLoss
|
||||
:special-members: __init__
|
||||
|
||||
|
||||
Metrics
|
||||
-------
|
||||
|
||||
.. autoclass:: nemo.collections.common.metrics.Perplexity
|
||||
:show-inheritance:
|
||||
:members:
|
||||
:undoc-members:
|
||||
Reference in New Issue
Block a user