Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Artificial Analysis

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 119

  1. Tencent Hunyuan outlines Hy4 roadmap and architecture trade-offs

    Tencent’s Hunyuan team held a two-hour Reddit AMA discussing the Hy4 model family, its architecture, deployment plans, evaluation practices, safety restrictions and product roadmap. The team said the next Hy model will be significantly larger, while Hy4 mini and Flash-Lite were in development. It also acknowledged Hy4’s tendency to overthink and said recursive self-improvement remains at an early stage. The AMA followed Tencent’s opening of Hy4’s weights and release of Hy4 flash; reported cost and ranking figures came from Tencent disclosures or third-party rankings.

    钛媒体 · 🔥 15
  2. Baseten releases bison-1 and groundhog-1 decision models

    Baseten launched bison-1 and groundhog-1, open-weight decision models built on Google’s Gemma 4 backbones. Both support text and image input, offer 128k-token context windows, and are available through Baseten Model APIs and with open weights on Hugging Face. Baseten says bison-1 ranked first among 19 models on Artificial Analysis Decision Index v2.1 with a score of 76 and recorded the index’s lowest Brier score.

    Baseten Blog · 🔥 5
  3. Parallel Search advanced tops Artificial Analysis Search Index

    Artificial Analysis benchmarked Parallel Search API’s fast and advanced modes across 1,700 search-focused tasks using its Stirrup harness and GPT-5.6 Luna. In the November runs, advanced scored 83 and ranked first among 26 entries on the Search Index, while fast scored 82 and ranked fourth. Both modes scored 89 F1 on DeepSearchQA, with fast averaging about $0.014 per task and advanced about $0.030.

    ArtificialAnlys (X) · 🔥 4
  4. Thinking Machines Lab releases Inkling 2 Mini open-weight model

    Thinking Machines Lab released Inkling 2 Mini, a 26.4B-parameter open-weight multimodal MoE model designed for local agentic workloads. Its 24 decoder layers include 12 middle layers that run three times per token, while the checkpoint has 3.4B active parameters and a reported 1M-token context window. Artificial Analysis independently placed it at 20 on its Intelligence Index, while Thinking Machines Lab reported leading results among open-weight models below 100B total parameters.

    TestingCatalog · 🔥 55
  5. Artificial Analysis to host open-weight model event in San Francisco

    Artificial Analysis announced an evening event in San Francisco on November 24 for teams building open-weight models. The program will begin with the latest Artificial Analysis benchmark data, followed by lightning talks and a panel discussion.

    ArtificialAnlys (X) · 🔥 0
  6. Artificial Analysis adds custom index builder to Data Playground

    Artificial Analysis introduced a custom-index builder in its Data Playground, letting users combine benchmarks, adjust weights and plot the resulting scores against other chart axes. According to the vendor, a model receives a custom-index score only when it has results for every evaluation included. The broader playground also offers formula metrics, launch-date playback, heat maps, grouped box plots and a workbench, and access is included with Artificial Analysis Pro.

    ArtificialAnlys (X) · 🔥 0
  7. Artificial Analysis adds following for model creators and API providers

    Artificial Analysis announced that signed-in users can follow model creators and API providers. Following an account is intended to surface scores when new measurements go live.

    ArtificialAnlys (X) · 🔥 0
  8. Google DeepMind launches Gemini 4 Neon

    Google DeepMind released Gemini 4 Neon, the fourth Gemini 4 model in roughly seven weeks, with a 1M-token context window and four effort levels. Latent Space reports pricing of $3 per million input tokens, $0.15 for cached input and $15 for output, with rollout planned for the paid Gemini API, AI Studio, Android Studio, Gemini for business and Antigravity. Preliminary results placed Neon second on Agent Arena and the Vals Index, while Artificial Analysis reported that it matched Carbon’s Intelligence Index score of 60 at high effort.

    Latent Space · 🔥 0
  9. Jev Adds Typed Decision Probabilities but Trails Some Rivals

    A Juejin analysis reports that TypeSafe AI released Jev on September 15, 2026. Jev accepts state and typed questions and returns option probabilities for classification tasks without generating free-form text. Version 1.14 added the Box primitive for image localization, while JevBench Capability fell from 77.1 for version 1.13 to 75.0; Calibration remained near 90, declining from 90.6 to 90.1. The analysis says Jev offers low latency but is mid-to-high priced among decision models, with some faster or more accurate competitors. It also notes that type safety confines answers to supplied options but does not guarantee they are correct.

    掘金 · 人工智能 · 🔥 0
  10. Google launches Gemini 4 Neon for high-frequency agentic work

    Google DeepMind launched Gemini 4 Neon on November 18, targeting complex software engineering, knowledge work, and scientific workflows with four reasoning levels and a 1-million-token context window. It is rolling out through the Gemini API, Gemini for Business, Google Antigravity, and the Gemini app, while a cyber variant is limited to eligible Fairwind Program members. Artificial Analysis measured Neon at 61 on its Intelligence Index with xhigh reasoning and second on the Vals Index; at the high setting, Neon and Gemini 4 Carbon both scored 60, while Neon generated about 110 output tokens per second versus Carbon's 57.

    Google DeepMind Blog · 🔥 32
  11. Microsoft-Decision-1.1 launches with Decision Index keynote spotlight

    Artificial Analysis reported that Microsoft-Decision-1.1 launched and that its Artificial Analysis Decision Index was featured in Satya Nadella’s Microsoft Ignite keynote. The post provides no benchmark scores, technical specifications, or independent confirmation of the launch details.

    ArtificialAnlys (X) · 🔥 0
  12. Artificial Analysis Adds Reasoning-Effort Controls

    Artificial Analysis announced reasoning-effort filters across all charts, homepage controls to switch between each model’s highest effort level and its API default, and a Model Release Comparison tool for comparing scores across effort levels. The announcement has not been independently verified.

    ArtificialAnlys (X) · 🔥 0
  13. Microsoft Adds MAI-Transcribe-2 to Dragon Copilot Transcribe

    Microsoft announced at Ignite 2026 that Dragon Copilot Transcribe now uses its in-house MAI-Transcribe-2 model for all clinician-patient conversation transcription. Microsoft says the model handles multilingual and code-switched conversations, supports speaker separation and word-level timestamps, and averages a 5.2% word error rate across 60 languages on FLEURS. The company also reports that the service processes about 10 million patient encounters per month and has cut errors by roughly 50% in multilingual workflows.

    IT之家 AI · 🔥 0
  14. Microsoft launches MAI Image 2.7, Flash variant and Canvas

    Microsoft released the MAI Image 2.7 and MAI Image 2.7 Flash image-generation and editing models in Microsoft Foundry public preview, with listed costs of about $35 and $10 per 1,000 images. The models support targeted edits, continuous-edit visual consistency and transparent backgrounds, while the Flash-powered Canvas workspace combines generation with local replacement, movement and style adjustments. Microsoft said MAI Image 2.7 scored 1,215 points on Artificial Analysis, four points above GPT Image 2.6 Sunburst (max) at roughly one-fifth the price, but noted that results depend on configuration, task and evaluation method.

    IT之家 AI · 🔥 3
  15. GPT-6.2 Astra ranks first on AA-3D interactive 3D benchmark

    Artificial Analysis reports that GPT-6.2 Astra ranked first on AA-3D, its benchmark for evaluating models that build interactive 3D experiences. In head-to-head comparisons with other models, human evaluators preferred scenes produced by GPT-6.2 Astra in 139 of 152 votes.

    ArtificialAnlys (X) · 🔥 0
  16. OpenAI updates Astra for Law with expanded legal search

    OpenAI released an updated Astra for Law, a GPT-6.2 Astra configuration combining an expanded legal search index with instructions for researching questions, weighing authorities and drafting answers. OpenAI reported that it led Harvey LAB-AA with 20.8% full-credit assignments and reached 53.8% full-credit answers on Vals AI’s Legal Research Bench. All ChatGPT Enterprise customers can request access through the Trusted Access Program, including API access.

    OpenAI · 🔥 0
  17. Claude Fable 5.2 gives shorter, more direct responses

    In AA-PersonalityBench, Claude Fable 5.2 was more direct than Claude Fable 5.1 and produced notably shorter responses with almost no em dashes. It ranked higher on Direct and Answer First but lower on Informativeness and Conviction. Its communication characteristics shifted by an average of 38 percentile points.

    ArtificialAnlys (X) · 🔥 0
  18. Artificial Analysis announces image and video AI benchmarking event

    Artificial Analysis announced an image and video AI benchmarking event for November 17 in San Francisco. The program will feature speakers from Artificial Analysis, fal, MiniMax AI and Microsoft AI, covering model-evaluation methods and a panel with media-generation leaders.

    ArtificialAnlys (X) · 🔥 0
  19. Artificial Analysis launches text-to-speech latency benchmark

    Artificial Analysis announced Time to First Audio, a benchmark that measures when text-to-speech models begin producing audible speech rather than when they return their first byte. It tests models daily with 12 prompts across four input lengths and reports a rolling seven-day mean; Simba 3.5 recorded 116 ms, Realtime TTS-2 186 ms, and Eleven v4 Turbo 258 ms.

    ArtificialAnlys (X) · 🔥 0
  20. Liquid AI releases d1.2 and d1.2-ultra decision models

    Liquid AI released d1.2 and d1.2-ultra with audio input and five API task types for reading values, extracting text spans, locating image objects, estimating counts and selecting multiple options. Artificial Analysis reported that d1.2-ultra scored 75 and ranked first on Decision Index v2.1, while Liquid AI separately reported a first-party AA-Paperclip score of 76. Both models are available through the Liquid API for $0.02 and $0.042 per million input tokens respectively; Liquid AI said accuracy for the five new tasks came from internal test sets because no public benchmark yet covers them.

    Liquid AI Blog · 🔥 0
  21. Fable 5.2 and the Squeeze on Wrapper-Agent Startups

    36氪, citing 壹娱观察, reports that Artificial Analysis scored Fable 5.2 at 65 in its composite intelligence index, placing it first. In an Anthropic demonstration, 1,000 agents allegedly completed a formal proof of Fermat's Last Theorem in 30 hours, while Opus 5.5 reached 27% of the same work in the same period. The analysis also notes that Fable 5.2 cost an average of $26.54 per task at its highest tier, compared with $10.04 for Opus 5.5, and that it lost to Gemini 4 Carbon in an office-automation test.

    36氪 人工智能 · 🔥 0
  22. Artificial Analysis Progress Index Top Score More Than Doubles Since December 2023

    Artificial Analysis reports that the top score on its Progress Index rose from 160 to 358 after the first GTA VI trailer appeared in December 2023. Of the 491 models on the index, 481 were released during that period, according to the report. The top score was surpassed on 23 separate days by models from OpenAI, Google DeepMind, xAI and Anthropic. GPT-4 Turbo held the top score on trailer day but would now rank 379th.

    ArtificialAnlys (X) · 🔥 0
  23. Alibaba releases Qwen4 Max with benchmark gains and lower task cost

    Artificial Analysis reported that Qwen4 Max scored 43 on its Intelligence Index at xhigh reasoning effort, nine points above Qwen3.8 Max and three points below Kimi K3.1 Pro. It improved on every cited Index evaluation versus Qwen3.8 Max, used 39% fewer output tokens per task, and cost $3.27 per Intelligence Index task, about 11% less than Kimi K3.1 Pro. The model supports a 1M-token context window and text and image input with text output. Alibaba's first-party APIs list pricing of $1.50 per million input tokens and $4.50 per million output tokens.

    ArtificialAnlys (X) · 🔥 0
  24. Inside Mina’s Real-Time Voice Meeting Assistant

    The report explains how the authors built Mina, their meeting assistant for natural turn-taking, follow-up questions, interruptions, calendar queries, and business-tool execution. Mina uses server-side wake-word detection with sherpa_onnx.KeywordSpotter, binds requests to a speaker and interaction window, and keeps server VAD while leaving response and interruption decisions to the application. Tool calls are validated and executed by the application; results are returned to Qwen before an explicit continuation is requested, while long-running work can be delegated to a background MeetingAgent and tracked by task ID. The current code defaults to qwen3.8-omni-flash-realtime, whereas the cited Speech-to-Speech leaderboard evaluated Qwen Audio 3.0 Realtime Plus. The authors say the connected model still needs validation with meeting samples. The implementation also includes latency monitoring across turn waiting, tool execution, continuation, playback preparation, and interaction quality.

    掘金 · 人工智能 · 🔥 0
  25. H3-Image, GPT Image 2.6 and Seedream 5.5 Face an Image-Model Test

    钛媒体 reports that MiniMax released H3-Image weights on November 10, after OpenAI introduced GPT Image 2.6 on November 5 and ByteDance released Seedream 5.5 on November 9. In hands-on tests through ChatGPT, Doubao and Hailuo AI, H3-Image produced images fastest, while GPT Image 2.6 showed stronger instruction following and editing. MiniMax’s claim of 16-megapixel images in 10 seconds at 50%-70% of comparable mainstream pricing was not fully reproduced, with standard mode taking about 25-30 seconds and high-speed mode 10-15 seconds in the report’s tests.

    钛媒体 · 🔥 0
  26. Artificial Analysis updates Coding Agent Index to v2.1

    Artificial Analysis said its Coding Agent Index v2.1 replaces FrontierCode v1.1 with FrontierCode-AA 2.0 and updates Terminal-Bench from 4.0 to 4.1. The revised index places Claude Fable 5.2 and Claude Opus 5.5 joint first with scores of 58. Claude Fable 5.2 at max scored 56 as more attempts reached task time limits. Artificial Analysis attributed an average five-point decline in model scores to the FrontierCode-AA 2.0 upgrade. Among configurations scoring at least 48, cost per task ranged from $1.51 to $44.22.

    ArtificialAnlys (X) · 🔥 0
  27. Artificial Analysis launches speech diarization benchmark

    Artificial Analysis announced the Diarization Index, a benchmark that evaluates speaker attribution in speech-to-text APIs using Word Diarization Error Rate (WDER). It covers 97 conversations involving two to eight people, with equal weight for each group size; NVIDIA’s Nemotron 3.5 Transcribe led the reported results at 3.3% WDER, followed by Mistral’s Voxtral Small Transcribe 3 at 7.5%.

    ArtificialAnlys (X) · 🔥 0
  28. Artificial Analysis announces first image and video AI event

    Artificial Analysis announced its first image and video event, scheduled for November 17 in San Francisco. Speakers include staff from Artificial Analysis, fal, MiniMax and Microsoft AI. The agenda will focus on measuring leading models and conclude with a panel on media generation.

    ArtificialAnlys (X) · 🔥 0
  29. Artificial Analysis Reportedly Updates Qwen 3.8 Flash Next Score to 29

    A report citing Artificial Analysis says the Qwen 3.8 Flash Next score was updated to 29. It places the model between GPT-6 Luna Max at 28 and Claude Haiku 5.5 High at 30, and closer to Qwen 3.8 max at 34 than to the 27B variant at 20. The supplied report does not explain the score’s methodology or release context.

    r/LocalLLaMA · 🔥 0
  30. Gemini 4 Hydrogen nears frontier models in independent tests

    Google DeepMind released Gemini 4 Hydrogen with a new xhigh reasoning level, according to Artificial Analysis. The model scored 54 on the Artificial Analysis Intelligence Index, one point below Claude Sonnet 5.5 and GPT-6.1 Sol at maximum reasoning, while the high setting matched Gemini 4 Argon at about 19% of its cost per task; Artificial Analysis also reported strengths in visual reasoning and low hallucination rates, but weaker agentic terminal-work scores. The model supports a 1M-token context window and text, image, video, and speech inputs, with pricing set at $1.50 per million input tokens and $7.50 per million output tokens.

    ArtificialAnlys (X) · 🔥 0

Next →

Experience and discussion from the community

Share my Artificial Analysis experienceAsk about Artificial Analysis

Nobody has shared their experience with Artificial Analysis yet.