# --- T2-COPYRIGHT-BEGIN ---
# t2/package/*/tiktoken/tiktoken.desc
# Copyright (C) 2026 The T2 SDE Project
# SPDX-License-Identifier: GPL-2.0
# --- T2-COPYRIGHT-END ---

[I] A fast BPE tokeniser for use with OpenAI's models

[T] tiktoken is a fast BPE tokeniser for use with OpenAI's models.

[U] https://github.com/openai/tiktoken

[A] tiktoken Authors
[M] Paul Manners <paul.manners@yahoo.com>

[C] extra/tool
[F] CROSS

[L] MIT
[V] 0.13.0

[D] d047b9acc438ca2d266833cb501784959e652f64cbb3748b8dfc590f tiktoken-0.13.0.tar.gz https://github.com/openai/tiktoken/archive/0.13.0/