Yes, They are not "AI". They are not "Thinking".
Many people simply do not understand that. It is very telling on how intelligent the global human population is.
Honestly, if humanity falls it might not because we nuke ourselves to death. It might be because the "useful idiots" think the "bots" are just as smart as a proper engineer.
With enough time, we will reach that point. But for now. Not so much.
The problem with that... It makes useful idiots think they are now as smart or smarter than an engineer. Yeah. Not so much.
[Edit] Oh, right. I also posted about Amazon now requiring senior engineers to sign off of anything a "AI" does (code, infra change, etc). Yep. That was today I think. Case and point.
People have been assigning human qualities to chat bots since the first even, primitive chat bot. It’s called the Eliza effect (posted by you). I’m not at all surprised that they see LLMs as intelligent. Some people will never be convinced that they’re not.
Those “useful idiots” are the same ones who think pajeets are just as smart as a proper engineer, or at least they want to believe that.
Someone else said that LLMs are just the latest plot to get rid of those damned, annoying, expensive programmers. There has been a number of these things; simplified languages like Basic, pajeets, LLMs. Some of these things are still being pushed. None of them will ever let idiots replace intelligent people.
I might have been the one talking about "they want to get rid of the programmers". It feels like something I would have said.