Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Agentic AI Revives the Case for Owned On-Premises Compute

AI summary

SiliconANGLE AI reports that agentic AI workloads are prompting some enterprises to own on-premises compute rather than rent it exclusively, citing economics, security, latency, and data control as motivations. Oxide Computer Co. CTO Bryan Cantrill argued that open-weight models and CPU-heavy workloads are encouraging deployments closer to enterprise data centers, while Upbound's Modelplane takes the opposite cross-cloud approach. The article does not quantify adoption, and its main evidence comes from an Oxide executive interview rather than independent market measurements.

In-depth insight

The model-placement decision is becoming both an infrastructure and data-governance choice for agentic AI deployments, with vendors promoting different approaches to routing inference and isolating workloads.

Agentic AI is reviving an argument over renting versus owning compute, and the model plane — the layer that decides where AI models run — sits at the center of it. Open-source efforts such as Upbound Inc.’s Modelplane route inference across clouds, but many enterprises want the models on hardware they control.

That shift favors companies that built early for on-premises cloud infrastructure. Oxide Computer Co., which raised $445 million in October to expand rack production, built its business on the idea that enterprises at scale will want to own their computers, according to Bryan Cantrill (pictured), co-founder and chief technology officer at Oxide.

“Cloud computing is great, but the model shouldn’t be exclusively to rent it. You get to a certain scale, as it turns out, you want to own your own computer,” Cantrill said.

Cantrill spoke with theCUBE Research’s John Furrier at SC26, during an exclusive broadcast on theCUBE, SiliconANGLE Media’s livestreaming studio. They discussed renting versus owning compute, why agentic workloads are moving on-prem and multi-tenancy for isolating those workloads.

Agentic workloads move on-prem

Agentic workloads are driving an explosion in compute demand, and much of it is CPU-heavy work that enterprises would rather own than rent. Economics remains the main reason to bring it in-house, but where models live is a close second, Cantrill explained. That makes the model plane as much a data governance decision as an infrastructure one.

#Upbound#Modelplane#Oxide Computer Co.#Broadcom#VMware

Original · 3 min readRead the original
Group chat

No comments yet. Start the conversation.