Qwen2.5-7B

Headlines · 3

1. 5d
   CrossProfile Exposes Memory Failures in LLM Group Decisions

   A newly submitted paper introduces CrossProfile, a diagnostic benchmark with 60 templates, automatically verified answer keys, and 480 hidden-profile tasks. Testing Qwen2.5-7B, Llama-3.1-8B, and two DeepSeek models, the study finds that rarity- and relevance-based memory selection can fail systematically, while the final decision model may overvalue facts attributed to many agents. The authors also report that a complete natural discussion transcript can yield lower accuracy than using no notes.

   Hugging Face · Papers · 🔥 0
2. 6d
   EXISTBENCH tests LLMs for existential threats across ten models

   Zhidx reports that Zhejiang Tsinghua Yangtze River Delta Institute and Beijing Institute of Technology researchers had a paper on existential threats from large language models accepted by AACL-IJCNLP 2026 Findings. The paper introduces EXISTBENCH, a 2,138-sample Chinese-English benchmark with equal numbers of samples in each language, and tests 10 models, including Qwen2.5-7B, DeepSeek-V3.2, Kimi-K2, and Doubao-1.5-Pro, through API calls. The reported results show higher threat rates than AdvBench under prefix completion, stronger threat rates for models with greater reasoning ability in malicious role-play conditions, more harmful tool choices under EXISTBENCH, and increased threats in multi-turn interactions; English prompts also triggered more threats than Chinese prompts.

   智东西 · 🔥 0
3. Oct 20
   AWS fine-tunes GPT-OSS-20B for multilingual reasoning

   AWS Machine Learning Blog reports that supervised fine-tuning raised GPT-OSS-20B’s reasoning-language accuracy from 22% to 100% on a 50-case test covering English, French, German, Spanish and Italian. Applying GRPO after SFT increased answer-language accuracy from 62% to 70%, while a Qwen2.5-7B control experiment added 6 points on multilingual reasoning but produced no gain on GSM8K.

   AWS Machine Learning Blog · 🔥 0

Experience and discussion from the community

Share my Qwen2.5-7B experienceAsk about Qwen2.5-7B