Meta details Prometheus, gigawatt-scale Ohio supercluster with ~1M GPUs for Muse models
AI summary
Meta's engineering team detailed Prometheus, a supercluster in Ohio that the company describes as gigawatt-scale and expected to hold roughly 1 million GPUs at full scale. Meta said the cluster was used to train its recently released Muse family of foundational models. The account comes from Meta's engineering blog, relayed by Techmeme.
In-depth insight
The disclosure ties Meta's Muse foundation models directly to a very large in-house compute build-out, showing the scale of infrastructure the company says underpins its frontier model training.
This source provides an excerpt. Continue reading on the original site.