Improving storage efficiency in Magic Pocket, Dropbox's immutable blob store

Dropbox packs more into less space—but users want their extra TBs

TLDR: Dropbox says its storage tech now wastes less space, reclaiming room with smarter cleanup and packing more data efficiently. Commenters cheer the engineering but demand open sourcing and bigger, cheaper plans—pointing to Google’s 5 TB deal—while a few defend the design as a hardware-driven necessity and ask if savings will reach users.

Dropbox just bragged that its in‑house storage system, Magic Pocket, learned a new trick: cleaning up wasted space so they can fit more of our files into fewer disks. Translation: they tuned how data is laid out, fought off a mess called “fragmentation,” and used smarter cleanup passes—like digital spring cleaning—to shrink overhead below their old baseline. Cool, right? The comments were like: “Cool for you. What about us?”

One camp rolled their eyes at the corporate victory lap. “All this talk about a tool that isn’t open source?” scoffed one user, accusing Dropbox of showboating without sharing the goods. Another camp went full hardware nerd, arguing that the “never edit old data” design isn’t just a flex—it's tied to SMR drives (a cheaper kind of hard disk), so the tricky cleanup is kind of the price of efficiency. Meanwhile, the peanut gallery unleashed the biggest clapback: if you’re saving all this space, why are our plans still 2–3 TB? One commenter waved a shiny comparison: Google just bumped an AI bundle to 5 TB for $20, asking if Dropbox’s wins ever reach customers.

There was also meta-drama: Does Amazon ever write tell‑all S3 posts like this? Some said Dropbox deserves credit for transparency; others said it’s all sizzle until storage caps move. The meme of the day: Magic Pocket playing storage Tetris while users yell, “Great score—now hand over the extra blocks.”

Key Points

  • Dropbox’s Magic Pocket is an exabyte-scale, immutable blob storage system optimized for durability and efficiency.
  • A recent placement change reduced write amplification but inadvertently increased fragmentation and storage overhead.
  • Immutable design means deletes don’t immediately free space; reclamation requires garbage collection and compaction.
  • Compaction rewrites live blobs into new volumes and retires old ones, translating deletes into reusable space.
  • Magic Pocket uses erasure coding for durability, reducing redundancy overhead compared to replication, but fragmentation dictates efficiency.

Hottest takes

"All this talk about a tool that isn’t open source?" — znnajdla
"The immutability of extents is dictated by their SMR hardware, I believe." — jeffbee
"Google recently increased storage from 2 TB to 5 TB on their $20 AI plan" — hs86
Made with <3 by @siedrix and @shesho from CDMX. Powered by Forge&Hive.
Improving storage efficiency in Magic Pocket, Dropbox's immutable blob store - Weaving News | Weaving News