Anthropic: AI Coding shows no productivity gains; impairs skill development

AI helpers don't make rookie coders faster and may stunt skills

TLDR: A new study finds AI coding help didn’t make average developers faster and hurt learning, especially for newbies. Commenters cheered the transparency, argued the headline was misleading, debated why GPT‑4o was used, and admitted they happily delegate boring tasks to AI—raising alarms about long‑term skills.

Anthropic-linked researchers dropped a spicy study on arXiv: AI coding assistants didn’t boost average speed and hurt learning for newcomers. Cue the comment section fireworks. One camp cheered the honesty—“nice to see an AI company let this out,” said kaelandt—while another slammed the headline as clickbait. jwr argued it’s really about novices, not everyone, and the nuance got lost in the hype.

The study’s gist: when folks leaned hard on AI to tackle a new coding library, their understanding, code-reading, and debugging suffered. Fully delegating tasks showed some productivity bump, but at a cost—skills didn’t stick. That set off the practical crowd, like baalimago, who shrugged: they already outsource boring stuff to “agentic coders” and don’t plan to learn those areas anyway. The vibes? A showdown between “AI as cheat code” and “AI as training wheels you never take off.”

Then came brand drama: simonw wondered why Anthropic researchers used GPT‑4o (an OpenAI model), sparking side-eye and meme energy. Others highlighted the paper’s nuance: there are smarter ways to use AI that keep your brain engaged. But the loudest takeaway from the thread was pure, relatable fear—fast code today, fewer skills tomorrow. The community is split between speed-chasers and skill-builders, with plenty of jokes about AI being the calculator your teacher warned you about.

Key Points

  • Randomized experiments studied developers learning a new asynchronous programming library with and without AI assistance.
  • AI use impaired conceptual understanding, code reading, and debugging abilities.
  • AI assistance did not deliver significant average efficiency gains.
  • Full delegation to AI improved productivity for some but reduced learning of the library.
  • Six AI interaction patterns were identified; three with cognitive engagement preserved learning outcomes.

Hottest takes

"The title of this submission is misleading" — jwr
"I delegate to agentic coders on tasks I need to have done efficiently" — baalimago
"I wonder why these Anthropic researchers chose GPT-4o" — simonw
Made with <3 by @siedrix and @shesho from CDMX. Powered by Forge&Hive.