sentencepiece v0.2.1
- Created
- Updated
SentencePiece is an unsupervised text tokenizer and detokenizer mainly for Neural Network-based text generation systems where the vocabulary size is predetermined prior to the neural model training
# License
# Supported Platforms
All platforms are supported
# Features
No features defined.
# Dependencies
and one transitive dependency:
- utf8-range (by protobuf )
# Host Dependencies
and one transitive dependency:
- vcpkg-cmake-config (by abseil )
# Dependents
No dependents.
# Host Dependents
No dependents.
# Contributors
Larry-Hu
Billy O'Neal
nicole mazzuca
7FrogTW
autoantwort
chausner
Thomas1664
JonLiu1993
Aung T Naing
jim wang
Jia Yue Hua
Kai Pastor
toge