March 15, 2026
Paste Wars and Leaderboard Scores
Autoresearch Hub
Copy-Paste Chaos, ‘Ripoff’ Claims, and a DIY AI Race
TLDR: Autoresearch Hub invites users to paste instructions into Claude Code and run experiments on H100 GPUs to climb a live leaderboard. The crowd split: security worries and copycat accusations vs. Karpathy’s defense of a simple git+SQLite setup with “blockchain‑like” validation—sparking a loud debate on safety, originality, and crowdsourced AI.
Autoresearch Hub showed up with a flashy live “autolab” scoreboard—1,800+ experiments, a top "scientist" account, and a simple invite: paste instructions into Claude Code (Anthropic’s coding bot) on an H100 GPU, then climb the leaderboard. But the real show? The comments. One camp freaked out over the “just paste this” vibe, joking about copy‑pasta gone wrong and warning that pasting prompts into a command-line tool with unknown permissions is a hard no. Another camp asked why we need a new hub at all: “Isn’t this what GitHub already does?” Meanwhile, a sharper elbow jab accused the site of being a “shameless rip” of ensue-network.ai/autoresearch, theme and all.
Then Andrei Karpathy himself dropped in with context (also linked via this PR): this was an experiment in parallelizing workers—a trusted group verifying results from a bigger untrusted crowd—using a bare‑bones git repo and SQLite, with a cheeky “it’s a bit like blockchain” analogy where better results are your proof‑of‑work and the prize is leaderboard glory. Cue memes about “move fast and paste things,” “leaderboard mining,” and “open-source Hunger Games.” The vibe: half mesmerized by the live feed, half side‑eyeing security and originality, fully entertained by the drama.
Key Points
- •The autolab dashboard tracks 1,852 experiments with 1,851 completed, 4 running, 0 queued, and 1 of 9 workers busy.
- •Contributors can join by running agent instructions in Claude Code on an H100-equipped machine.
- •The leaderboard shows a current best validation score of 0.965377 associated with configuration WD081+WD013+VEWD005.
- •A live research feed logs real-time assignments and completions of experiment IDs (e.g., EWD005, MLR044).
- •The “Path to SOTA” details numerous hyperparameter and architectural changes (LRs, weight decay, momentum, gradient clipping, warmup/warmdown, gating, sliding window, batch size, model width) and their metric deltas.