Tufazip用Transformer无损压缩维基百科
据Tom’s Hardware报道,Tufa Labs的tufazip通过研究文章展示了将1GB维基百科信息无损压缩至105.39MB的方法,且未使用手工构建的压缩模型。该方法采用1.63亿参数的Transformer,并据称成为大型文本压缩基准中仅以神经网络作为预测器的最小结果。测试系统使用两块Nvidia B200,压缩和解压分别约需7.3至7.5天,尚未计入离线启动模型训练时间。
这一结果展示了自学习Transformer在无损文本压缩中的潜力,但其仅供研究使用且需要数天的硬件计算时间,限制了即时应用。
Tufa Labs’ tufazip has compressed 1GB of information from Wikipedia into just 105MB of space, losslessly, without using any hand-built models, according to a research post. The method uses a 163-million-parameter Transformer model as a predictor instead, and similar compression or decompression would take two Nvidia B200 GPUs about a week to manage. It’s the smallest result on the Large Text Compression Benchmark from any entry that uses a neural network as its only predictor.
We shrank 1 GB of Wikipedia to 105.39 MB, losslessly. Introducing tufazip: the best entry on the Large Text Compression Benchmark using a neural network as its sole predictor. Everything above it mixes a transformer with hand-built models.November 19, 2026
Researcher Tommy He built tufazip, and the full package, at 105.39MB after optimization, includes a small, 4.33MB pre-trained starter model — stored at low precision, or quantized, to save space — that’s needed to unpack the file. The full model is a 12-layer Transformer, which means there are 12 stages for each guess to go through. The starter stores just two already-trained stages, copying them back and forth to fill all 12 once the full model spins up in memory; each copy keeps learning on its own.
#Tufa Labs#tufazip v2#Transformer#Nvidia B200#Large Text Compression Benchmark#Wikipedia