wobbly
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Reddit test finds no clear position sensitivity in Haiku 4.5 or Sonnet 5
A Reddit user tested whether moving the document containing an answer changes a model’s response by placing it among distractors at different positions. The experiment used Haiku 4.5 and Sonnet 5 with 5, 15 and 30 short documents; both models recorded zero answer flips at 5 and 15 documents, while the apparent 4% flips at 30 documents were only variations between “3” and “three.” The author says the result applies to easy, single-fact retrieval and did not test long documents, multi-hop questions or less obvious evidence.
r/MachineLearning · 🔥 0
Experience and discussion from the community
Share my wobbly experienceAsk about wobbly
Nobody has shared their experience with wobbly yet.