Google launches Cloud Dataflow, says MapReduce tired

Google launches Cloud Dataflow, says MapReduce tired

Summary: Google launches a service called Cloud Dataflow that aims to analyze pipelines with "arbitrarily large datasets."


Google on Wednesday launched Cloud Dataflow, a big data analytics service to crunch information in either streaming or batch mode.

The announcement, made at Google's I/O keynote in San Francisco, helps round out the search giant's cloud stack, which is adding features as it aims to take on Amazon Web Services.

Urs Hölzle, senior vice president at Google, outlined Dataflow and a demo revolved around crunching Twitter data and sentiment around World Cup games. Dataflow was the headliner in a series of cloud services outlined. 

Hölzle said that Dataflow has replaced MapReduce inside Google. Cloud Dataflow is designed to analyze pipelines with "arbitrarily large datasets."

"Cloudflow does for entire pipelines what MapReduce did for single flows," he said.

Roughly speaking, Google's Cloudflow would line up against Amazon Web Services Redshift, a datawarehouse service, and AWS' Elastic MapReduce, which uses Hadoop to crunch large datasets.

data flow
cloud flow
cloud data flow


Topics: Cloud, Big Data, Data Centers, Google

Kick off your day with ZDNet's daily email newsletter. It's the freshest tech news and opinion, served hot. Get it.


Log in or register to join the discussion
  • Make Money from Google

    Start working from home! Great job for students, stay-at-home moms or anyone needing an extra income... You only need a computer and a reliable internet connection... Make $90 hourly and up to $12000 a month by following link at the bottom and signing up... You can have your first check by the end of this week.........................
    • Application Example

      One use of this service is to stream comment posts into it before posting them on the site. Using word, phrase and sentiment recognition, if they contain phrases like "work from home" or "make money from google" or "extra income" NEAR "stay-at-home moms" you can dump them immediately. Gosh, wouldn't that be great?
      Cloud Guy
      • Great idea Cloud Guy

        So when is the IPO for this idea. The potential is boundless considering the number of times one runs across a post like the above.