OASIS

Headlines · 2

1. Oct 23
   OASIS adds null routing to attention residuals

   A team from Northwestern University, the Illinois Institute of Technology, Rutgers University, and other institutions proposed OASIS, whose token- and depth-level null options let Attention Residuals abstain from assigning full probability mass to real branches. According to Xinzhiyuan’s report on the paper, the method was accepted to NeurIPS 2026 and reduced average activation kurtosis by 95.90% versus Vanilla AttnResidual across LLaMA-3.2-1B, Qwen3-0.6B, and Phi-4. The reported experiments also found a 13.21-point Qwen3-0.6B W4A4 GSM8K Pass@1 advantage over Vanilla AttnResidual and recovered 77.3%–91.8% of selected RULER and LongBench performance losses at 12K-token contexts.

   新智元 · 🔥 0
2. Oct 11
   Amazon reportedly in talks to buy Decart for about $7B

   The Wall Street Journal reported that Amazon is negotiating to acquire San Francisco AI startup Decart in a deal that could be valued at around $7 billion, a report relayed by Bloomberg, IT之家 and others. Founded in 2023, Decart sells a cross-chip optimization layer called DOS that lets AI workloads move across Nvidia GPUs, Amazon Trainium and Google TPU, and also builds the real-time video model Lucy and the interactive-environment model Oasis. Reports say Anthropic discussed a roughly $6 billion acquisition in August and walked away after due diligence, while Nvidia was also named as a possible suitor; Amazon and Decart did not comment, and TechRepublic noted CTech floated a possible $5.5 billion valuation.

   The Next Web · 🔥 0

Experience and discussion from the community

Share my OASIS experienceAsk about OASIS