AI Inference Startups Buy Their Own Chips Amid Compute Shortages
AI summary
The Information reports that some AI inference startups are beginning to purchase their own AI chips as they struggle to secure enough cloud computing capacity for customers. Others are sourcing capacity from dozens of smaller neoclouds, though a recent hack of Fireworks highlights the security risks of this approach.
In-depth insight
A shift from leasing hyperscaler capacity to owning chips or relying on smaller neoclouds could materially change AI inference businesses, while the reported Fireworks hack underscores infrastructure security risks.
This source provides an excerpt. Continue reading on the original site.
#Fireworks AI#Microsoft Azure#Amazon Web Services#Google Cloud