Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

AA-AgentPerf

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 2

  1. ArtificialAnlys: DeepSeek V4.1 Flash agent throughput up to 1.5x on GB300 NVL72

    ArtificialAnlys reports that DeepSeek V4.1 Flash running on NVIDIA GB300 NVL72 gained up to 1.5x tokens per second per agent over the past month on its AA-AgentPerf benchmark, which tests datacenter systems running realistic agentic coding workloads. A single agent reached 848 tok/s, up from 596 (1.42x), while throughput per GPU rose roughly 1.6x at about 80 tok/s per agent. ArtificialAnlys attributes the gains to a newer vLLM version, new vLLM kernels for DeepSeek V4.1 on GB300, FlashInfer autotuning, fuller CUDA graph coverage, tuned speculative decoding, and running prefill and decode on the same GPUs in NVIDIA’s updated Dynamo + vLLM setup.

    ArtificialAnlys (X) · 🔥 0
  2. AA-AgentPerf Adds Daily GPU Rental Pricing and Throughput-per-Dollar Metric

    Artificial Analysis announced a collaboration with Silicon Data to add market-based GPU rental prices to the AA-AgentPerf datacenter benchmark. The new “Throughput per $/hr” metric divides a system's serving throughput by its hourly rental cost, with current indices covering H100, H200, B200 and B300 across cloud providers. AA-AgentPerf results show NVIDIA's B300 generally leading among systems with rental data, while the B200 matches it at faster output speeds on some models.

    ArtificialAnlys (X) · 🔥 0

Experience and discussion from the community

Share my AA-AgentPerf experienceAsk about AA-AgentPerf

Nobody has shared their experience with AA-AgentPerf yet.