LinkedIn opens up Pinot to give more developers a taste

Pinot now serves as the data analytics foundation for at least 25 products in the LinkedIn portfolio, including popular features such as "Who Viewed My Profile" and "Who Viewed My Posts."

LinkedIn is open sourcing one of its newer big data products crafted in house in a move to satiate developers.

Pinot was first uncorked last fall as the social network's new web-scale real-time analytics engine.

Cultivating for roughly two years, Pinot was designed for monitoring, managing, and utilizing massive quantities of big data generated by multiple products across LinkedIn's budding empire of professional social and digital publishing products.

"Pinot was born as an answer to our problems," wrote LinkedIn engineer Praveen Neppalli Naga at the time.

Pinot now serves as the data analytics foundation for at least 25 products within the LinkedIn portfolio, including popular features such as "Who Viewed My Profile" and "Who Viewed My Posts."

Since September, Pinot has piqued the interest of many "consumer internet companies," according to Kishore Gopalakrishna, a software engineer specializing in data infrastructure at LinkedIn.

Gopalakrishna elaborated in a blog post on Wednesday that these other unnamed organizations with "similar needs" as LinkedIn could benefit from Pinot's support for crunching real-time analytics at massive scale.

As far as LinkedIn goes, those needs previously included drumming down response times to sub-seconds, near real-time data refreshing and a system that could still serve up data-based insights even as hardware goes down.

But gifting Pinot to the open source community is not necessarily an act of pure generosity as Gopalakrishna acknowledged a few benefits for LinkedIn in the deal as well.

"Open sourcing is a win­-win situation," Gopalakrishna said, noting LinkedIn both benefits from further contributions by others in the open source community as well as attracting more top engineer talent to its platform.

Newsletters

You have been successfully signed up. To sign up for more newsletters or to manage your account, visit the Newsletter Subscription Center.
See All
See All