Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Tiiny Pocket tests show trade-offs between local-AI speed and coding performance

AI summary

Reddit user /u/IronDiligent6698 tested three local language models on a Tiiny Pocket running TiinyOS 0.1.36. In median speed results, Qwen3.5-9B-Turbo was fastest at about 75 output tokens per second, while Qwen3.6-35B-A3B-Turbo reached about 64 tokens per second and gpt-oss-120b averaged about 16. In a coding test, the 9B model produced no gradable result, the 35B model passed 9 of 10 tests, and gpt-oss-120b passed all 10 in about 229 seconds; the latter two took roughly 235 and 229 seconds, respectively. The author kept each model’s best run and acknowledged possible gaps in the testing method. The user also reported that personal-model import and Hugging Face installation were unavailable, while the team had reportedly planned an import tool.

In-depth insight

The report provides a first-person account of running relatively large local models on compact hardware and documents concrete speed, coding-performance and model-selection constraints. Its methodology and results were not independently reproduced, so the figures should be treated as one user’s reported tests rather than a broadly verified benchmark.

#Tiiny Pocket#TiinyOS#Qwen3.5-9B-Turbo#Qwen3.6-35B-A3B-Turbo#gpt-oss-120b#Hugging Face

Original · 4 min readRead the original
Group chat

No comments yet. Start the conversation.