Celia kung biography

Brooklin—a distributed service for streaming data in near real-time and at scale—has been running in production at LinkedIn since 2016, powering thousands of data streams and over 2 trillion messages per day.

Today, we are pleased to announce the open-sourcing of Brooklin and that the source code is available in our Github repo!

Why Brooklin?

At LinkedIn, our data infrastructure has been constantly evolving to satisfy the rising demands for scalable, low-latency data processing pipelines.

Challenging as it is, moving massive amounts of

data reliably at high rates was not the only problem we had to tackle. Supporting a rapidly increasing variety of data storage and messaging systems has proven to be an equally critical aspect of any viable solution.

We built Brooklin to address our growing needs for a system that is