

35·
3 days agoThe real question is whether the author doesn’t understand what he’s writing about, or whether he does and is trying to take advantage of users who don’t for clicks.
The real question is whether the author doesn’t understand what he’s writing about, or whether he does and is trying to take advantage of users who don’t for clicks.
I mean, maybe in the very long term that’s a fundamental limit, and you face things like Dyson spheres.
But right now, I’m personally running one human-level AGI on roughly 100W of power, so I’m just gonna say that as things stand, the prominent limitation is software not being good enough. You’re, like, a software guy.
Ultimately AI is an optimization problem, and if we don’t know how to solve the software problems fully yet, then, yeah, we can be inefficient and dump some of the heavy lifting on the hardware guys to get a small edge.
But I’m pretty sure that the real breakthrough that needs to happen isn’t on the hardware side. Like, my existing PC and GPU already are more capable than my brain from a hardware standpoint. The hardware guys have already done their side and then some compared to human biology. It’s that we haven’t figured out the software to run on them to make them do what we want.
The military or whoever needs AI applications can ask for more hardware money to get an edge relative to competitors. But if you’re the (well, ex-) head of Google, you’re where a lot of those software and computer science guys who need to make the requisite software breakthroughs probably are, or could be. Probably the last people who should be saying “the hardware guys need to solve this”.
It’s going to be some more profound changes to what we’re doing in software today than just tweaking the parameters on some LLM model, too. There’s probably some hard research work that has to be done. It’s not “we need immense resources dumped into manufacturing more datacenters and powerplants, and chips”. It’s translating money into having some nerdy-looking humans bang away in some office somewhere and figure out the required changes to what needs to be done in software to get us there. Once that happens, then okay, sure, one needs hardware to make use of that software. But in July 2025, we don’t have the software to run on that hardware, not yet.