TTR-Compressor

Headlines · 1

1. Oct 22
   Test-time regression powers a new sequence compressor

   A technical report by Sihan Yang and six coauthors introduces TTR-Compressor, which represents a compressed sequence using coefficients fitted through test-time regression. The regression is trained end to end through backpropagation, while coefficients are calculated in closed form during the forward pass; in author-reported tests, the method improved RULER performance with block-wise sparse attention and matched a standard MLP merger with 55.6% fewer visual tokens.

   Hugging Face · Papers · 🔥 0

Experience and discussion from the community

Share my TTR-Compressor experienceAsk about TTR-Compressor