December 20, 2025
Bench-Laws & Order
Origins of the TPC and the first 10 years
How “benchmark cops” tamed the wild West of vendor bragging
TLDR: TPC’s origin story shows how it set rules and enforcement to curb sketchy performance claims. Commenters are split between praising the “benchmark police” and insisting vendors still game the tests—crucial because these numbers steer massive buying decisions and the industry’s bragging rights.
Throwback alert: Kim Shanley’s history of the Transaction Processing Performance Council (the group behind industry speed tests) dropped, and the comments turned into a courtroom. Half the thread cheers the rise of the “benchmark police”, saying TPC finally set rules and enforcement so vendors couldn’t inflate numbers. Old-timers relived the chaotic TP1 era—an ATM test without actual users or networks—calling it “benchmarketing at its finest.” Others argue benchmarks still feel like fantasy league stats: shiny but disconnected from real checkout lines and bank queues. The TPC gets props for adding process, but skeptics say loopholes never die; they just get better lawyers.
Humor flew faster than transactions. One meme dubbed it “Law & Order: Benchmark Unit,” another joked Aristotle just joined the mod team to enforce good laws. A fiery split emerged: fans credit TPC’s reviews for forcing fair play; critics swear vendors optimize for the test, not for real customers. Nostalgic commenters name-drop Jim Gray’s anonymously published checklist as the moment “the wild West got city council.” Meanwhile, punsters riffed on ATMs with no humans—“press F for think-time”—and “TPC-C doping” became the phrase of the day. Verdict from the crowd: benchmarks help, but trust is still under constant audit.
Key Points
- •TPC’s early mission centered on creating robust benchmarks and establishing strict review and monitoring processes to ensure fair competition.
- •Omri Serlin’s initiative and leadership were instrumental in founding the TPC and shaping its early direction.
- •The 1980s shift to OLTP, initially focused on ATM transactions, drove demand for credible performance measurement as the industry grew to billions in sales.
- •Vendors widely used IBM’s TP1 benchmark, which measured ATM transactions in batch mode and omitted network and user interaction, leading to inflated results.
- •TP1’s poor definition and lack of oversight undermined credibility with press, researchers, and users, prompting calls for better standards, including efforts like Jim Gray’s 1985 Datamation article.