College professor had students grade ChatGPT-generated essays. All 63 essays had hallucinated errors

[highplainsdem]

46. See this:

https://spectrum.ieee.org/ai-hallucination

Whether or not inaccurate outputs can be eliminated through reinforcement learning with human feedback remains to be seen. For now, the usefulness of large language models in generating precise outputs remains limited.

I'm talking about the AI being hyped and used now, despite all the mistakes it makes.

And I find this a silly point to try to make:

Humans make stuff up. The question is will AI's ever make stuff up less than the average person?

The people using AI for business, for example, are not trying to make stuff up. AI they're using may very well do so regardless of their intent.

You wouldn't defend a calculator that often gives incorrect answers by saying that humans can flub math questions, too. I hope you wouldn't, anyway.

For that matter, no one in their right mind would want to use a calculator that didn't work.

It's really pathetic that so many people are eager to use fallible AI whose results have to be checked very carefully.

But I think there are three main reasons for the popularity of ChatGPT and similar LLMs:

1) Gullibility. People expect computer results to be accurate, and they're impressed as well by the chatbot's fluent, authoritative-sounding prose.

2) Laziness. This applies to the cheaters, whether students or adults who think AI can handle chores they don't like or give them the appearance of having skills and talents they don't have - an illusion that will crumble as soon as they're deprived of the AI.

3) Greed. This applies to all the people who think they'll become richer, quickly, using AI, whether those people are employers hoping to lay off employees, or people dreaming of get-rich-quick schemes where AI gives them marketable writing, code, etc.