Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Tufazip Uses a Transformer to Losslessly Compress Wikipedia Data

AI summary

Tufa Labs’ tufazip reduced 1 GB of Wikipedia information to 105.39 MB losslessly, without hand-built compression models, according to a research post reported by Tom’s Hardware. The method uses a 163-million-parameter Transformer and reportedly achieved the smallest result among benchmark entries relying on a neural network as their only predictor. On the reported test system, compression and decompression each took roughly 7.3–7.5 days on two Nvidia B200 GPUs, excluding offline starter-model training.

In-depth insight

The result shows that a self-learning Transformer can deliver competitive lossless text compression, but its research-only status and multi-day hardware requirements limit immediate practical use.

Tufa Labs’ tufazip has compressed 1GB of information from Wikipedia into just 105MB of space, losslessly, without using any hand-built models, according to a research post. The method uses a 163-million-parameter Transformer model as a predictor instead, and similar compression or decompression would take two Nvidia B200 GPUs about a week to manage. It’s the smallest result on the Large Text Compression Benchmark from any entry that uses a neural network as its only predictor.

We shrank 1 GB of Wikipedia to 105.39 MB, losslessly. Introducing tufazip: the best entry on the Large Text Compression Benchmark using a neural network as its sole predictor. Everything above it mixes a transformer with hand-built models.November 19, 2026

Researcher Tommy He built tufazip, and the full package, at 105.39MB after optimization, includes a small, 4.33MB pre-trained starter model — stored at low precision, or quantized, to save space — that’s needed to unpack the file. The full model is a 12-layer Transformer, which means there are 12 stages for each guess to go through. The starter stores just two already-trained stages, copying them back and forth to fill all 12 once the full model spins up in memory; each copy keeps learning on its own.

#Tufa Labs#tufazip v2#Transformer#Nvidia B200#Large Text Compression Benchmark#Wikipedia

Original · 4 min readRead the original
Group chat

No comments yet. Start the conversation.