GPUs in the wine cellar: techies are stockpiling home AI compute
The Information reports that former Microsoft executive and startup founder Gary Flake built a custom machine with seven NVIDIA GPUs dangling from its frame in his Bellevue, Wash., basement to train custom AI models on terabytes of EEG brain-activity data. He said assembling it from discounted parts cost under $6,000 total and was far cheaper than paying AWS or Microsoft monthly to train in the cloud—even counting the $10,000 to $20,000 he spent on electrical upgrades and a new HVAC system to keep the basement cool. He plans to start using the computer again for a new AI project in the coming months, saying, “I want to own. I don’t want to rent.”
Home-built compute is becoming cost-competitive for a few individuals, but the electrical and cooling costs show why the approach does not scale easily.
This source provides an excerpt. Continue reading on the original site.