Stochastic Parrots: Frequently Unasked Questions

The internet is fighting over whether chatbots are genius… or just fancy mimics

TLDR: Emily Bender says her famous “stochastic parrots” phrase was about the limits and risks of chatbot text, not a blanket slogan about all “AI.” The comments instantly split into a brawl: some praised her for puncturing hype, while others said she’s ignoring how shockingly capable chatbots now seem.

Emily Bender is back to remind everyone what “stochastic parrots” was actually supposed to mean: not “all AI is fake,” but that large language models — the text generators behind today’s chatbots — can sound convincing without truly understanding what they’re saying. In her new piece, she says people have spent years flattening, misquoting, and meme-ifying the phrase until it escaped the original paper and became a full-blown internet label for chatbots everywhere.

And wow, the comments did not disappoint. One camp treated the article like a much-needed reality check, cheering Bender on for cutting through what one commenter basically called industrial-strength nonsense. Another camp rolled its eyes so hard you could hear it through the screen, with one brutally short response summing up the backlash as: “What a hill to die on.” Ouch. The real drama, though, came from people saying the world has changed since the paper first appeared — and that Bender should admit chatbots have become more impressive than critics expected. One commenter practically demanded a sequel titled “Okay, I didn’t expect this either.”

Then came the philosopher-kings of the thread: people arguing over whether predicting words is secretly a kind of world understanding after all. Add in the glorious line that “maybe the last people capable of thinking will be linguists,” and the whole discussion turned into a glorious brawl between skeptics, believers, and exhausted onlookers wondering whether the parrot discourse will ever die. Spoiler: absolutely not.

Key Points

  • Emily M. Bender says the phrase “stochastic parrots,” introduced in the 2021 paper, gradually spread from referring to the paper to being used more broadly for large language models.
  • The article aims to address misconceptions about both how large language models work and what Bender’s work on the subject has argued.
  • Bender quotes the original paper’s definition of a language model as producing text without communicative intent, world grounding, or a model of the reader, calling it “a stochastic parrot.”
  • She says the term was one of several attempts to describe text-synthesis behavior, and notes that later work also used the phrase “synthetic text extruding machine.”
  • Bender states she has not said “AI is a stochastic parrot” and argues the original paper focused on the risks and harms of increasingly large language models rather than “AI” in general.

Hottest takes

"What a hill to die on." — leonidasv
"Maybe the last people capable of thinking will be linguists." — radkZ
"I am very surprised by how far LLMs have come..." — libraryofbabel
Made with <3 by @siedrix and @shesho from CDMX. Powered by Forge&Hive.