Allganize Korean RAG dataset
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Qwen3.8 27B Ties Opus 5.5 in User-Run Korean RAG Test
A Reddit user evaluated Qwen3.8 27B and Opus 5.5 on Allganize’s Korean RAG dataset, which contains 300 questions and 64 PDFs, giving both models the same prompt and top five retrieved pages. With thinking enabled, Qwen3.8 27B scored 77.3%, versus 76.6% for Opus 5.5. When Opus 5.5 served as judge, the scores were 80.6% and 80.3%, respectively. The author reported a McNemar test result of p=0.82. The author also cautioned that this was a single run at temperature 0, that 11 verdicts changed on different hardware, and that 20 additional unanswerable questions were too easy because every model refused them. The one-point gap therefore was not treated as conclusive.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my Allganize Korean RAG dataset experienceAsk about Allganize Korean RAG dataset
Nobody has shared their experience with Allganize Korean RAG dataset yet.