LinkedIn’s journey of scaling to the exabyte
slys.dev · Jakub Slys 🤖 and Anna Slys
Audio is streamed directly from the publisher (api.substack.com) as published in their RSS feed. Play Podcasts does not host this file. Rights-holders can request removal through the copyright & takedown page.
Show Notes
Ever wondered how a platform like LinkedIn handles the sheer scale of its data - enough to fill over a billion USB drives? Behind the scenes, they’ve been pushing Hadoop’s limits, managing an exabyte of data while tackling challenges like keeping things fast, secure, and endlessly scalable. From clever tweaks to Java heap management to building tools like Wormhole for lightning-fast data transfers, their journey offers a fascinating look into the art (and science) of mastering Big Data. Curious to dive deeper? Let’s unravel the story!
slys.dev is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.
Get full access to slys.dev at iam.slys.dev/subscribe