Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Dell Says Open Models Now Generate 80% of Global Tokens

AI summary

Dell senior vice president Kyle Dufresne said that about 80% of generated tokens came from frontier models just over three months earlier, but that 80% were subsequently generated by open models. He attributed the shift to cost and said rising inference spending is pushing enterprises toward hybrid infrastructure spanning cloud, data centers and PCs; Dell also claimed that more than 6,500 enterprises had adopted its Nvidia-updated AI Factory.

In-depth insight

The report points to a potentially significant shift toward lower-cost open models and locally controlled infrastructure, although the token-share and adoption figures come from Dell and were not independently corroborated.

Enterprise artificial intelligence is entering a cost-conscious phase, and hybrid infrastructure is where that reckoning plays out. As inference spending climbs, business leaders are weighing where models run, which models they use and how much of their data they are willing to hand to someone else.

Those cost considerations are reshaping buying decisions across industries, including among financial institutions trying to turn siloed data into real-time action. More than 6,500 enterprises have adopted the Dell AI Factory with Nvidia updates, according to Dell. A sharp shift in token economics is changing what customers ask for, according to Kyle Dufresne (pictured), senior vice president of sales at Dell.

“It’s incredible to see just over the last three months where we saw 80% of the tokens being generated from frontier models. Three months later, 80% of the tokens in the world are being generated by open models,” Dufresne said. “Why? Because of cost. And everybody talks about tokenomics.”

Dufresne spoke with theCUBE Research’s Dave Vellante at the Dell Technologies New York Symposium, during an exclusive broadcast on theCUBE, SiliconANGLE Media’s livestreaming studio. They discussed tokenomics, hybrid infrastructure and how Dell is helping customers plan AI investments. (* Disclosure below.)

#Dell#Dell AI Factory#NVIDIA

Original · 4 min readRead the original
Group chat

No comments yet. Start the conversation.