July 14, 2026
Benchmark or barnyard?
Show HN: Benchmark your eng team's AI agent maturity in 5 minutes
A 5-minute AI team quiz lands online—and the comments instantly turn into roast mode
TLDR: A startup posted a quick quiz claiming it can rate how advanced your team is at using AI tools, based on answers from 200-plus teams. But commenters turned it into a roast, joking about bots taking the quiz, mocking the "software factory" label, and questioning whether the scoring is too generous.
A new Show HN post is pitching a 9-question quiz that claims it can tell software teams how "mature" they are at using artificial intelligence tools during the process of building apps. The makers say it’s based on data from 200+ engineering teams and asks a simple-but-loaded question: how far can your AI helpers get before a human has to step in? Sounds neat, right? The community response: not so fast.
Instead of quietly comparing scores, commenters immediately turned the whole thing into a mini drama festival. One of the sharpest digs compared the benchmark to "sheep measuring" who’s closest to the front of the flock—a brutal way of saying this may be more about trend-chasing than real progress. Another user went full comedy mode, saying they got their AI agent to fill out the quiz for them, only for the bot to refuse to reveal the result. That joke basically wrote itself, and commenters seemed delighted by the absurdity.
But the real nerd fight broke out over the phrase "software factory." One commenter argued factories make the same thing over and over, while software is new every time, proposing "machine shop" instead. Even people who scored well were skeptical: one user said they got a high rating just for using autocomplete, search, and review tools, which made the whole scoring system feel a little too flattering. So yes, the quiz is live—but the real benchmark may be how hard the internet can side-eye it.
Key Points
- •The post offers a five-minute benchmark made up of nine questions for assessing engineering teams’ AI agent maturity.
- •It compares a team’s SDLC against data from hundreds of teams building agent-driven software workflows.
- •The article says more than 200 software engineering teams have been benchmarked.
- •Scores are calibrated using anonymous assessments spanning startups, scale-ups, and enterprises.
- •The benchmark was built by the Islo team, described as coming from the people behind Incredibuild.