Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Dell and AMD scale enterprise AI with modular rack infrastructure

AI summary

Dell Technologies and AMD are expanding an enterprise AI infrastructure strategy built around Dell PowerEdge servers, AMD Instinct accelerators and the modular Dell AI Platform with AMD. The platform integrates AMD ROCm for on-premises model training, fine-tuning and serving, while Dell has added support for AMD Instinct MI350P PCIe GPUs in the PowerEdge XE7745 and R7725 servers. Dell representatives say AMD-based systems can consolidate multiple servers and improve rack density, though those performance and efficiency figures have not been independently verified.

In-depth insight

The collaboration gives enterprises a modular, on-premises path combining AMD CPUs and accelerators, ROCm software and Dell servers, with MI350P support extending deployment options for inference and generative AI workloads.

Dell Technologies Inc. and its partner Advanced Micro Devices Inc. face similar competitive pressures. Both tech powerhouses operate in a business climate where success is now measured across central processing units, graphics processing units, rack-scale systems, memory capacity, network bandwidth and tokens per dollar.

The pressure to compete across those measures underscores what theCUBE Research has termed “Engineering Velocity.” Since the Dell Technologies World event in May, AMD and Dell have not slowed their pace of collaborations and announcements.

AMD and Dell are working to build enterprise AI infrastructure that can keep pace with changing workloads and customer requirements.

“In AI infrastructure, the winner may not be the company with the best benchmark on keynote day,” said theCUBE Research’s Dave Vellante. “It will more likely be the company whose engineering system learns, validates and improves the entire platform faster than anyone else.”

This feature is part of SiliconANGLE Media’s exploration of the architectural shifts powering continuous, production-grade AI. Be sure to check out theCUBE’s “Dell AI Data Platform Event: From Ambition to AI at Scale” and its past coverage of this year’s Dell Technologies World. (* Disclosure below.)

#Dell Technologies#AMD#Dell AI Platform with AMD#Dell PowerEdge#AMD Instinct MI350P#AMD ROCm#AMD EPYC#AMD Instinct

Original · 7 min readRead the original
Group chat

No comments yet. Start the conversation.