A Reddit user tested whether moving the document containing an answer changes a model’s response by placing it among distractors at different positions. The experiment used Haiku 4.5 and Sonnet 5 with 5, 15 and 30 short documents; both models recorded zero answer flips at 5 and 15 documents, while the apparent 4% flips at 30 documents were only variations between “3” and “three.” The author says the result applies to easy, single-fact retrieval and did not test long documents, multi-hop questions or less obvious evidence.
A University of York study, as reported by Juejin AI, compared five code representations—AST, call graph, dependency graph, documentation, and a hybrid view—exposed through MCP tools against a search-only baseline on a fixed Claude Code stack. For localization tasks, the reported configurations saved 25–39% of tokens while improving recall, but gains were limited when the bottleneck was generating correct patches or tests; a call-graph configuration also improved success on SecBench.
When an intelligent agent handles enterprise tasks, it often spends considerable effort on preparatory work: finding APIs, browsing directories, parsing spreadsheets, and determining which script generated a particular table. Change the question, and all that preparation gets repeated. Models can certainly keep getting stronger, but if many tasks take place in the same workspace, we can ask anothe…
The Research system Anthropic unveiled in June 2025[1] organizes a research problem into a process of analysis, parallel search, and synthesis of results. Beyond model capabilities, how work is allocated and how results from different directions are connected have also become design questions that AI engineering needs to answer separately.
Along this line, I want to ask a deeper question: if even …