Pivotal bets on Tachyon as next in-memory file system

Pivotal said Tachyon is part of the next generation of data lake technology that will leverage the availability of in-memory processing with an architecture that supports multiple analytics workloads.

EMC's platform-as-a-service initiative Pivotal is shifting its engineering focus to the open-source project Tachyon.

Developed in partnership with the AMPLab at UC Berkeley, which also brought to life the Apache Spark framekwork, Pivotal said Tachyon is part of the next generation of data lake technology that will leverage the availability of in-memory processing with an architecture that supports multiple analytics workloads.

Pivotal refers to Tachyon as a "butterfly architecture" that provides a memory-centric caching layer for disparate data sources, and says it will serve as the memory-based data exchange layer within the data lake. And because it's pluggable, existing storage and processing systems can co-exist with the framework.

In addition to integrating Tachyon development with its big data suite, Pivotal is also supporting the project through a research fellowship program designed to advance the Tacyhon project through fellowship and internship support.

EMC is reportedly looking to integrate Tachyon with the flash storage product DSSD, as well as its Isilon technologies.

"EMC is excited to join with Pivotal in supporting and fostering the rapidly innovating Big Data ecosystem," EMC's CTO John Roese said in a statement. "The next wave of real-time analytics will be made possible by technologies such as Apache Spark and Tachyon, in combination with innovative storage products such as EMC’s recent DSSD acquisition."

Newsletters

You have been successfully signed up. To sign up for more newsletters or to manage your account, visit the Newsletter Subscription Center.
See All
See All