Hadoop adoption and innovation is moving forward at a fast pace, playing a critical role in today's data economy.
But, how fast and far will Hadoop go heading into 2015?
Prediction 1: Hadooponomics makes enterprise adoption mandatory. The jury is in. Hadoop has been found not guilty of being an over-hyped open source platform. Hadoop has proven real enterprise value in any number of use cases including data lakes, traditional and advanced analytics, ETL-less ETL, active-archive, and even some transactional applications. All these use cases are powered by what Forrester calls “Hadooponomics” — its ability to linearly scale both data storage and data processing.
What it means: The remaining minority of dazed and confused CIOs will make Hadoop a priority for 2015.
Virtualization has swept through the data center in recent years, enabling IT transformation and serving as the secret sauce behind cloud computing. Now it’s time to examine what’s next for virtualization as the data center options mature and virtualization spreads to desktops, networks, and beyond.
Prediction 4: The Hadoop skills shortage will disappear. Hadoop is not that hard to understand. It is a file system, albeit distributed, and it is a computing platform, albeit distributed. The APIs are Java. What’s the big deal? Digging in to a new open source platform and learning the APIs is nothing new to enterprise Java application developers. They have to do it continuously to keep up and keep their résumés fresh. Hadoop is no different. The shortage of Hadoop skills will quickly disappear as enterprises turn to their existing application development teams to implement projects such as filling data lakes and developing MapReduce jobs using Java.
Let’s not forget about the operations skills needed to maintain a Hadoop cluster. Same thing. DevOps continuously deal with a complex heterogeneous environment. For those familiar with business intelligence, SQL on Hadoop will open the door to familiar access to their data. And while experienced technology management professionals take the bull by the horns, the open source community and commercial vendors are building better tools to make using Hadoop easier to use for everyone.
What it means: CIOs won’t have to hire high-priced Hadoop consultants to get projects done. Hadoop projects will get done faster because the enterprise’s very own application developers and operations professionals know the data, the integration points, the applications, and the business challenges. Additional skills for more complicated applications, such as predictive analytics running inside Hadoop, can be built when needed over time.