Multimodal Knowledge Agent (MKA)
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 2
- Reddit user tests MKA benchmark across six AI workflows
A Reddit submitter tested an Education/History task from Hugging Face against Google and Artificial Analysis's Multimodal Knowledge Agent (MKA) benchmark rubric. The six AI workflows included GPT, Gemini, Claude, and NotebookLM; some produced polished presentations but struggled with numerical accuracy. The submitter published the results, actual answers, and observations in a separate blog.
r/OpenAI · 🔥 0 - Google DeepMind and Artificial Analysis launch MKA benchmark
Google DeepMind and Artificial Analysis launched the Multimodal Knowledge Agent (MKA) evaluation, which tests agents on 200 private visual tasks drawn from 10 industries, including architectural drawings, engineering schematics, and clinical scans. Tasks are scored against expert rubrics averaging about 70 weighted criteria, with Climb WSR as the headline metric; Artificial Analysis runs them in its Stirrup harness with code execution, web access, and image-viewing tools. Artificial Analysis reports Claude Fable 5.2 leading with a 57% Climb WSR, followed by Gemini 4 Carbon at 54% and Claude Opus 5.5 at 53%, alongside substantial differences in cost per task.
ArtificialAnlys (X) · 🔥 0
Experience and discussion from the community
Share my Multimodal Knowledge Agent (MKA) experienceAsk about Multimodal Knowledge Agent (MKA)
Nobody has shared their experience with Multimodal Knowledge Agent (MKA) yet.