tiktoken

Headlines · 1

1. 4h
   ttok 0.4 released with a --list-models command

   Simon Willison released version 0.4 of ttok, his command-line token counting tool built on OpenAI's open source tiktoken library. The update fixes a Click warning, refreshes the CI setup, and adds a --list-models command for listing available models. The tool runs via uvx, so tokens can be counted with a command like cat file.txt | uvx ttok.

   Simon Willison's Weblog · 🔥 9

Experience and discussion from the community

Share my tiktoken experienceAsk about tiktoken