Hortonworks overhauls update cadence, partners with HPE

Hortonworks said Apache Hadoop components will be updated once a year to maintain a stable core. Extended services will be updated more frequently.
Written by Larry Dignan, Contributor

Hortonworks on Tuesday said that it will alter the way it distributes its enterprise version of Hadoop and said it will collaborate with HP Enterprise.

The company, which competes with Cloudera, will alter the way it updates its data platform.

Specifically, Hortonworks said it will update core Apache Hadoop components such as HDFS, MapReduce, Yarn and Apache Zookeeper annually. Services that run on top of core Hadoop such as Spark, Hive, HBase and Ambari will be grouped together and updated throughout the year.

Hortonworks also launched its Hortonworks Data Platform and DataFlow. Hortonworks Data Flow 2.4 includes the latest generation of Apache Spark 1.6 and DataFlow 1.2 as well as other updates. DataFlow also includes streaming analytics tools as well as Apache Kafka and Storm.

What Hortonworks' approach highlights is the maturation of enterprise Hadoop. Like Red Hat's approach, Hortonworks is aiming to keep a stable core and provide key innovations.

As for the HPE collaboration, the companies said the aim is to optimize the enterprise performance of Spark, which is an open source cluster computing framework.

Editorial standards