Show HN: DeltaGlider – Store 4TB of build artifacts in 5GB
Show HN (score: 5)Description
UPLOAD: It stores the first file in a S3 path as a full-size (reference), but saves next uploaded archives as deltas (tiny binary diffs) with respect to the reference.
DOWNLOAD: it reconstructs the original file on the fly, bit-perfect and verified with SHA256.
Why Xdelta3? It's a compression-aware and block-level binary diff algorithm. Perfect for representing differences between archives, where small changes shift bytes but most content stays the same. It can efficiently delta compress ZIP/JAR/TAR archives up to 99.9% between versions, provided the difference in compressed content is overall small.
Killer use cases Software versioning, periodic db. backups, JAR, ZIP, TGZ.
The impact for us was "2 orders of magnitude" storage price reduction. I hope you can benefit from it too!
License: GPLv3
Feedback and contributions are super welcome!
More from Show
Show HN: Matrirc – run irssi in 2026, talk to people on Matrix
Show HN: Matrirc – run irssi in 2026, talk to people on Matrix This solves no real problem — Element works, there's already a Matrix-to-IRC bridge running on half the FOSS networks, and probably nobody under 30 has opened irssi voluntarily this decade.<p>I wrote it anyway because I miss Esc 4 and clunky window-split commands.<p>Matrirc is a local IRC server that speaks Matrix on the back. Point irssi at localhost:6667, log in with Matrix creds, rooms show up as channels.<p>brew tap pawelb0/tap brew install matrirc
No other tools from this source yet.