LLMs reward expertise

Turns out the chatbot isn’t the genius — the expert in the chair still matters most

TLDR: The article argues that chatbots are most useful when the person using them already knows the field well, because expertise helps pull better answers out of the same tool. Commenters mostly agreed that skill still matters, though some joked that fancy prompting advice gets overhyped and sounds suspiciously like “just ask harder.”

The big claim in this piece is deliciously simple: chatbots don’t magically make everyone equally smart. Yes, they can help almost anyone fake their way to “pretty decent” work, but the people getting the truly impressive results are the ones who already know the subject cold. The article points to famed mathematician Terence Tao grilling ChatGPT on a mind-bending math problem and basically making the bot sound smarter by knowing exactly what to ask, what to ignore, and when to push back. In other words: the secret sauce isn’t the machine — it’s the human with receipts.

And the comments? Oh, they were absolutely ready. One camp nodded along hard, arguing that these tools are like multipliers: if you bring real skill, you get real leverage. As one commenter put it, more ability means more impact. Another said this isn’t just about prompting, it’s about knowing how to structure the work in the first place — because yelling “make me Microsoft Flight Simulator, make no mistakes” at a bot is not, sadly, a strategy. But not everyone was buying the high-minded take. One skeptic fired back with a mock-prompt that basically joked the whole thing boils down to “everything depends on it, think really hard,” which is exactly the kind of community eye-roll that keeps these debates spicy. There was also a mini reality check from the art crowd: ask an image generator for something fancy without knowing photography or design, and the result will look sloppy fast. The mood across the thread was clear: AI helps, but the pros are still driving — and the amateurs are still very much in the passenger seat.

Key Points

  • The article argues that domain expertise is the most important skill for getting better results from LLMs.
  • It uses Terence Tao’s ChatGPT discussion about a counterexample to the Jacobian Conjecture as its main example.
  • According to the article, Tao’s prompts are short, direct, and guided by his own judgment rather than by fully following the model’s suggestions.
  • The author says expertise enables users to recognize weak responses, extract useful ideas, and redirect the model toward more suitable solutions.
  • The article concludes that human expertise remains important because, in many tasks, the bottleneck is specifying and steering the desired result rather than the model lacking information.

Hottest takes

"Claude, make me Microsoft Flight Simulator, make no mistakes" — walrus01
"More ability, more impact!" — cheriot
"everything depends on it. think really hard" — postalcoder
Made with <3 by @siedrix and @shesho from CDMX. Powered by Forge&Hive.