[COPY] --- T2-COPYRIGHT-BEGIN --- [COPY] t2/package/*/sentencepiece/sentencepiece.desc [COPY] Copyright (C) 2022 - 2026 The T2 SDE Project [COPY] SPDX-License-Identifier: GPL-2.0 [COPY] --- T2-COPYRIGHT-END --- [I] Unsupervised text tokenizer for Neural Network-based text generation [T] SentencePiece is an unsupervised text tokenizer and detokenizer mainly [T] for Neural Network-based text generation systems where the vocabulary [T] size is predetermined prior to the neural model training. [U] https://github.com/google/sentencepiece [A] Google [M] René Rebe [C] base/development [E] add protobuf [L] APL [V] 0.2.2 [P] X -----5---9 160.000 [D] 0432d904c350bb0e9bff13bd4bb11df9c94386b8e0c1f066a5311de7 sentencepiece-v0.2.2.tar.gz https://github.com/google/sentencepiece/archive/v0.2.2/ hook_add postmake 6 "cd python; ${pyscript:-python} setup.py build install ${pyconfopt:=--prefix $root/$prefix} "