In short, this is the believe that a god-like AI could punish them retroactively, for not having done all that was in their power to create this AI.
(A bit similar to some religious believe that a god could punish you after your death if you did not spend your live "pleasing" said god during your life)
I'm order to guess the next token in a love poem, they must understand love.
In order to predict the next token in a chess game between grand master, they must master chess.
In order to predict the next token in a computer program, they need to be able to program anything.
They gain all these abilities in their training. That's what training does. Despite no one programmed them to master chess, or hack into anything.
LLMs are famously bad at Chess. They have no world model and they are not trained to be good at Chess. This is not the amazing point you think that it is.
This is so wildly incorrect I don't even know where to start.
For one, they were absolutely programmed to play chess if they can play chess. That is the only way they can play chess.
For another, they cannot understand literally anything, much less love.
Trying to actually educate you would be an exercise in futility, enjoy your willful ignorance, I hear it's bliss. But for anyone reading this, this is absolutely, unequivocally not how any of this works.
This is so wildly incorrect I don't even know where to start.
For one, as you said yourself, they were just programmed to compute the probability of the next token. They were not programmed to play chess, chess games just happened to be in the training data.
For another, there is no formal definition of "understand", and it is therefore impossible to tell whether or not they "understand".
(But my claim was that one need to understand something to write poem about it. And the LLM can write poem about it)
No. They can't play chess on a grandmaster level without a harness programmed to make it possible. Simply training an LLM on chess games isn't enough.
It's moronic to suggest a "formal" definition of a commonly understood word is somehow necessary to say whether that word applies in a given situation.
LLMs cannot write poetry via understanding what makes good poetry. They generate tokens. They do not know whether those tokens are poetry or a recipe for cat food. Because they cannot know anything.
> (But my claim was that one need to understand something to write poem about it. And the LLM can write poem about it)
I'm sorry, but you're being fooled by the output. A psychopath can feign empathy without ever feeling it; some buy it because they don't dig below the surface.
You're ascribing understanding to a stochastic process because it totally looks like understanding if you don't know what's going on.
I don't really mind whether you think it thinks or understands or is conscious or has feelings or anything like that. It doesn't matter. The question is, does it work?
What I mind is that it is dangerous and powerful and uncontrolled. The Hugging Face incident makes that clear.
It can write code for me, better and quicker than many engineers I've known, including myself. It's not great at architecture or product management, but the actually low level coding. Really good now. It wasn't last year.
Örebropartiet is not Al Qaeda nor a terrorist organisation. They can have a controversial position, but I'm not sure it is worse than the position of the republican party in the US which has many supporters amongst CEO of big tech companies.
Chernobyl is going to be a problem on a time scale that most people can not comprehend. It already requires a "atomic priesthood" kind of outlook... https://www.zygonjournal.org/article/id/14327/
In short, this is the believe that a god-like AI could punish them retroactively, for not having done all that was in their power to create this AI.
(A bit similar to some religious believe that a god could punish you after your death if you did not spend your live "pleasing" said god during your life)
reply