mykola/freebsd-ports
1
0
Fork 0
forked from Lainports/freebsd-ports
Code Pull requests Activity
freebsd-ports/textproc/py-tiktoken/pkg-descr
Po-Chuan Hsieh 6c34be9ab1
textproc/py-tiktoken: Add py-tiktoken 0.4.0 
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
2023-08-22 01:01:58 +08:00

1 line
63 B
Text
Raw Blame History

tiktoken is a fast BPE tokeniser for use with OpenAI's models.
View git blame Copy permalink