Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

AA-AgentPerf Adds Daily GPU Rental Pricing and Throughput-per-Dollar Metric

AI summary

Artificial Analysis announced a collaboration with Silicon Data to add market-based GPU rental prices to the AA-AgentPerf datacenter benchmark. The new “Throughput per $/hr” metric divides a system's serving throughput by its hourly rental cost, with current indices covering H100, H200, B200 and B300 across cloud providers. AA-AgentPerf results show NVIDIA's B300 generally leading among systems with rental data, while the B200 matches it at faster output speeds on some models.

In-depth insight

The update adds a current cost dimension to AI system-performance comparisons, allowing users to assess how much serving throughput a GPU configuration delivers per dollar of hourly rental cost.

We are collaborating with Silicon Data to bring market-based GPU pricing into AA-AgentPerf, our datacenter system performance benchmark

Our users and partners want to know how much agent work they can support per dollar of compute. @silicondata's rental price indices allow us to report a reliable value-for-money metric, updated daily as prices change. We currently display Silicon Data indices for H100, H200, B200 and B300, tracked across cloud providers

The new metric is Throughput per $/hr, which divides the total throughput of a system and serving configuration by the hourly cost of renting that system. Among systems with available rental pricing, NVIDIA’s B300 generally leads, while B200 matches it at faster output speeds on some models

Note: the below chart includes an MI355X rental rate that has been assumed by Artificial Analysis based on recent market quotes

#AA-AgentPerf#Artificial Analysis#Silicon Data#NVIDIA B300#NVIDIA B200#NVIDIA H100#NVIDIA H200#AMD MI355X

Original · 1 min readRead the original
Group chat

No comments yet. Start the conversation.