Skip to content

sentencepiecev0.2.1

Updated

SentencePiece is an unsupervised text tokenizer and detokenizer mainly for Neural Network-based text generation systems where the vocabulary size is predetermined prior to the neural model training

#License

Apache-2.0

#Supported Platforms

All platforms supported.

#Features

No features defined.

#Dependencies

and one transitive dependency:

#Host Dependencies

and one transitive dependency:

#Used By

No ports use this.

#Host Tool For

No ports use this.

#Contributors

  • Larry-Hu's avatarLarry-Hu
  • Billy O'Neal's avatarBilly O'Neal
  • nicole mazzuca's avatarnicole mazzuca
  • 7FrogTW's avatar7FrogTW
  • autoantwort's avatarautoantwort
  • chausner's avatarchausner
  • Thomas1664's avatarThomas1664
  • JonLiu1993's avatarJonLiu1993
  • Aung T Naing's avatarAung T Naing
  • jim wang's avatarjim wang
  • Jia Yue Hua's avatarJia Yue Hua
  • Kai Pastor's avatarKai Pastor
  • toge's avatartoge

#Changelog

  • 7f8b4cd
    7f8b4cd[sentencepiece] update to 0.2.1 (#47546)
  • ef7dbf9
    ef7dbf9[protobuf] Don't emulate module for find_package(protobuf) (#45959)
  • 2a8dc1b
    2a8dc1b[vcpkg baseline][sentencepiece] Fix flags, linkage, deps (#42226)
  • c33b5dd
    c33b5dd[sentencepiece] update to 0.2.0 (#37777)
  • 72f36d7
    72f36d7[sentencepiece] Fix port (#35283)
  • 365d1e9
    365d1e9[sentencepiece] update to 0.1.99 (#34749)
  • 15ea681
    15ea681[sentencepiece]make sure that Release only build is supported (#27442)
  • 14d353a
    14d353a[sentencepiece] update to 1.97 (#27427)
  • 1c67923
    1c67923[sentencepiece] Clarify supported triplets (#23438)
  • 4b39282
    4b39282[sentencepiece] Update to 0.1.96 (#21370)
Show 6 earlier changes

#Port Files