SentencePieceTokenizer.ConfigΒΆ
Component: SentencePieceTokenizer
-
class
SentencePieceTokenizer.
Config
[source] Bases:
ConfigBase
All Attributes (including base classes)
- sp_model_path: str =
''
Default JSON
{
"sp_model_path": ""
}
Component: SentencePieceTokenizer
SentencePieceTokenizer.
Config
[source]Bases: ConfigBase
All Attributes (including base classes)
- sp_model_path: str =
''
Default JSON
{
"sp_model_path": ""
}