Tufazip Uses a Transformer to Losslessly Compress Wikipedia Data
Tufa Labs’ tufazip reduced 1 GB of Wikipedia information to 105.39 MB losslessly, without hand-built compression models, according to a research post reported by Tom’s Hardware. The method uses a 163-million-parameter Transformer and reportedly achieved the smallest result among benchmark entries relying on a neural network as their only predictor. On the reported test system, compression and decompression each took roughly 7.3–7.5 days on two Nvidia B200 GPUs, excluding offline starter-model training.
The result shows that a self-learning Transformer can deliver competitive lossless text compression, but its research-only status and multi-day hardware requirements limit immediate practical use.
Tufa Labs’ tufazip has compressed 1GB of information from Wikipedia into just 105MB of space, losslessly, without using any hand-built models, according to a research post. The method uses a 163-million-parameter Transformer model as a predictor instead, and similar compression or decompression would take two Nvidia B200 GPUs about a week to manage. It’s the smallest result on the Large Text Compression Benchmark from any entry that uses a neural network as its only predictor.
We shrank 1 GB of Wikipedia to 105.39 MB, losslessly. Introducing tufazip: the best entry on the Large Text Compression Benchmark using a neural network as its sole predictor. Everything above it mixes a transformer with hand-built models.November 19, 2026
Researcher Tommy He built tufazip, and the full package, at 105.39MB after optimization, includes a small, 4.33MB pre-trained starter model — stored at low precision, or quantized, to save space — that’s needed to unpack the file. The full model is a 12-layer Transformer, which means there are 12 stages for each guess to go through. The starter stores just two already-trained stages, copying them back and forth to fill all 12 once the full model spins up in memory; each copy keeps learning on its own.
#Tufa Labs#tufazip v2#Transformer#Nvidia B200#Large Text Compression Benchmark#Wikipedia