Why does ChatGPT say it’s “thinking”?

It’s a real process you’re watching, not a loading animation. OpenAI (and the others do something similar) have just decided to call it “thinking”.

In the early days of these tools, you asked a question and got an answer straight back, with no working shown. For harder questions, that has changed.

Many tools now use something called chain of thought reasoning. The tool takes your question, builds itself a plan, and checks its own working at each step before it answers. That takes time.

They are also increasingly using tools of their own partway through, like running a web search. Each of those adds a few seconds. It all adds up, which is why some answers come back noticeably slower than others.

Rather than leave you looking at a blank screen wondering what’s happening, most tools now show you a summary of what they’re doing. You can see the steps it went through to reach its answer.

It still isn’t thinking, though. There’s no understanding of your question sitting behind it, and no concept of what’s true. Working through more steps makes a good answer more likely. It doesn’t make the answer correct.

If your child is using these tools for homework, those visible steps are worth opening up and reading. When an answer has gone wrong, the steps usually show you where more clearly than the answer does.

Discover more from Raising Generation AI

Subscribe now to keep reading and get access to the full archive.

Continue reading