Why AI Training Costs Millions: A Look at the 'Gigafactory of Compute'
I’m often asked which AI training project cost millions of dollars and two years of my life. People wonder: why is it so expensive? My usual answer is that it’s not particularly expensive—especially considering we don’t own our own hardware yet. Training AI has always been about massive data centers; that’s just the reality of the field. When you’re not immersed in it, the sheer scale can be hard to visualize. ...