CrossProfile
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- CrossProfile Exposes Memory Failures in LLM Group Decisions
A newly submitted paper introduces CrossProfile, a diagnostic benchmark with 60 templates, automatically verified answer keys, and 480 hidden-profile tasks. Testing Qwen2.5-7B, Llama-3.1-8B, and two DeepSeek models, the study finds that rarity- and relevance-based memory selection can fail systematically, while the final decision model may overvalue facts attributed to many agents. The authors also report that a complete natural discussion transcript can yield lower accuracy than using no notes.
Hugging Face · Papers · 🔥 0
Experience and discussion from the community
Share my CrossProfile experienceAsk about CrossProfile
Nobody has shared their experience with CrossProfile yet.