> you could do ca. 1200 prompts per double decker. Which is a lot.
If humans had evolved to do prompts (while retaining everything else that makes human thought human), that number doesn't sound that big.
OTOH, if LLMs had to do everything humans need energy for, that number would be waaay too big for LLMs.
----
Humans don't even have an efficient energy input system. How many of those 1.3M joules actually get assimilated? Silicon is a lot more efficient at energy, because a lot of effort has been put into making it so, and is fed raw energy. It doesn't need to process food like humans, humans already did that for it when they captured the energy in electricity.
----
I'm sure there's more ways of making the comparison more fair, but I doubt your parent was trying to prove their claim with such deep research. So let me try another angle: No human can burn through as much energy as the top hosted LLMs do for one prompt, in as much time.
If humans had evolved to do prompts (while retaining everything else that makes human thought human), that number doesn't sound that big.
OTOH, if LLMs had to do everything humans need energy for, that number would be waaay too big for LLMs.
----
Humans don't even have an efficient energy input system. How many of those 1.3M joules actually get assimilated? Silicon is a lot more efficient at energy, because a lot of effort has been put into making it so, and is fed raw energy. It doesn't need to process food like humans, humans already did that for it when they captured the energy in electricity.
----
I'm sure there's more ways of making the comparison more fair, but I doubt your parent was trying to prove their claim with such deep research. So let me try another angle: No human can burn through as much energy as the top hosted LLMs do for one prompt, in as much time.