sentencepiece v0.2.0
- Created
- Updated
SentencePiece is an unsupervised text tokenizer and detokenizer mainly for Neural Network-based text generation systems where the vocabulary size is predetermined prior to the neural model training
# License
# Supported Platforms
All platforms are supported
# Features
No features defined.
# Dependencies
and one transitive dependency:
- utf8-range (by protobuf )
# Host Dependencies
and one transitive dependency:
- vcpkg-cmake-config (by abseil )
# Dependents
No dependents.
# Host Dependents
No dependents.
# Contributors
- Larry-Hu
- Billy O'Neal
- nicole mazzuca
- 7FrogTW
- autoantwort
- chausner
- Thomas1664
- JonLiu1993
- Aung T Naing
- jim wang
- Jia Yue Hua
- Kai Pastor