Humanities Last Exam

Headlines · 1

1. 4d
   Community test compares 2.25bpw DeepSeek-V4.1-Flash with official API

   A r/LocalLLaMA author compared ISTA-DASLab's DeepSeek-V4.1-Flash-1017-GSQ-RCO-GGUF 2.25bpw quantization with the official DeepSeek API on a 100-question, text-only subset of Humanities Last Exam. Among 74 questions the API completed, semantic accuracy was 19/74 for the local quantization and 21/74 for the API; the author called this a preliminary smoke test because differing token limits, non-completion, and substantial run-to-run variance limited the comparison.

   r/LocalLLaMA · 🔥 0

Experience and discussion from the community

Share my Humanities Last Exam experienceAsk about Humanities Last Exam