Reddit用户用六种AI工作流测试MKA基准
一名Reddit用户将Hugging Face上的教育与历史任务,交给Google和Artificial Analysis的Multimodal Knowledge Agent(MKA)基准评分规则进行测试。测试涵盖GPT、Gemini、Claude和NotebookLM等六种AI工作流,其中部分工具生成的演示效果精致,但数字准确性较差。提交者随后另行发布了结果、实际答案和观察。
这次实测具体展示了不同AI工作流完成一项多模态知识任务时的表现,但单一任务的测试范围限制了结论的普遍性。
Google and Artificial Analysis recently introduced the Multimodal Knowledge Agent (MKA) benchmark, and I thought it would be interesting to try it myself! I downloaded an Education/History task from Hugging Face and tested it across six AI workflows, including GPT, Gemini, Claude, and NotebookLM.
I compared their outputs against the grading rubric, and the results were quite interesting. Some tools created great-looking presentations but struggled with getting the numbers right.
I put together a small blog sharing the results, actual answers, and a few things I noticed.
Here's what I found
#Google#Artificial Analysis#Hugging Face#Multimodal Knowledge Agent (MKA)#GPT#Gemini#Claude#NotebookLM