Create

Sign in to ReadmeX

Sign in to join communities, post, vote and chat.

or

New here?

Story

ttok 0.4 released with a --list-models command

AI summary

Simon Willison released version 0.4 of ttok, his command-line token counting tool built on OpenAI's open source tiktoken library. The update fixes a Click warning, refreshes the CI setup, and adds a --list-models command for listing available models. The tool runs via uvx, so tokens can be counted with a command like cat file.txt | uvx ttok.

Why it matters: Lightweight token counters remain handy for developers estimating context limits or API costs.

ttoktiktokenOpenAI

9
Source excerptSimon Willison's Weblog

Release: ttok 0.4 ttok is my CLI tool for counting tokens, using OpenAI's open source tiktoken library. It hasn't been in updated in a couple of years, but I finally fixed a Click warning, updated CI, and added a --list-models command to list available models. It works with uvx, so you can count tokens in anything like this: cat file.txt | uvx ttok Tags: projects, ai, openai, generative-ai, llms, tokenization…

This is the outlet's own summary. Read the full story on the original site.

Read the original →

How we got here

  1. OpenAI's annualized revenue said to be closer to $50B, not $70BThe Information · OpenAI
  2. AI safety group paid influencers to spread superintelligence doom messaging36氪 人工智能 · OpenAI
  3. Hands-on: ChatGPT's Intelligent UI builds clickable lessons, not just text36氪 人工智能 · OpenAI
  4. OpenAI on the Jev-inspired Decisions API: built in a week36氪 人工智能 · OpenAI
  5. OpenAI's math advances spark a reckoning for academiaBloomberg Technology · OpenAI
  6. Microsoft makes its Execution Containers for AI agents generally availableCNET · OpenAI

Comments

I've used this: share my experience What I think: share my view
How important is this story?No ratings yet

No comments yet. Start the conversation.