Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Tiny Corp launches the $30,000 tinybox Red Kimi workstation

AI summary

Tiny Corp announced the $30,000 tinybox Red Kimi, a desktop workstation designed to run Moonshot AI's 2.8-trillion-parameter Kimi K3 locally. It pairs four AMD Radeon AI Pro R9700 GPUs with 128 GB of aggregate GDDR6 memory and sixteen 1 TB NVMe SSDs, while a tinygrad driver is designed to let the GPUs access NVMe storage directly. Tiny Corp claims Kimi K3 generation at 40 tokens per second, but TechRadar reports that the figure has not been tested outside the company and that its test methodology remains unspecified.

In-depth insight

The system offers a concrete desktop configuration for running Kimi K3 locally, but its headline performance remains an unverified vendor claim.

  • Tiny Corp's $30,000 tinybox Red Kimi pairs four Radeon AI Pro R9700 GPUs (128 GB GDDR6) with sixteen 1 TB NVMe SSDs
  • A tinygrad driver lets the GPUs read the 238.4 GB/s SSD array directly to run Moonshot's 2.8-trillion-parameter Kimi K3
  • Tiny claims 40 tokens per second, but the math involves caching nearly all of each token's weights in VRAM

There is nothing tiny about Tiny Corp's latest tinybox, the tinybox Red Kimi: It costs a mammoth $30,000 and pairs four AMD Radeon AI Pro R9700 graphics cards with sixteen 1 TB NVMe SSDs, all with one goal in mind: running Moonshot AI's 2.8-trillion-parameter Kimi K3 on a desk rather than in a data center.

Each R9700 carries 32 GB of GDDR6 at 640 GB/s, giving the four cards 128 GB of GPU memory and 2,560 GB/s of aggregate bandwidth to go with a system built on Tiny Corp's G5 platform, with a 32-core AMD Epyc Genoa processor whose exact model the tinybox configurator doesn't name, and a modest 32 GB of DDR5 system memory in tow.

#Tiny Corp#tinybox Red Kimi#Moonshot AI#Kimi K3#AMD#Radeon AI Pro R9700#tinygrad

Original · 4 min readRead the original
Group chat

No comments yet. Start the conversation.