Google BigQuery: Self-service cloud data analysis, from your iPad or desktop

Google BigQuery: Self-service cloud data analysis, from your iPad or desktop

Summary: Google made its BigQuery service publicly available last month. So I decided to put it through its paces, and compare it to Microsoft’s Excel and PowerPivot.

SHARE:

 |  Image 8 of 11

  • While your table’s being created, you can monitor the progress of the data load task by clicking the “Job History” link at the upper-the left of the screen.  This brings up the "Recent Jobs" screen pictured here.  Despite the reference to “history” in the link, you can view running jobs too.  Click one and you’ll get the detail shown here.

  • Of course, if you’ve got data in CSV format, nothing stops you from opening it in Excel.  From there, you could save the data in Excel’s own file format, then start crunching its numbers.

  • Google describes BigQuery as a column store database that works well for OLAP (OnLine Analytical Processing) queries.  Microsoft PowerPivot, a free add-in for Excel 2010, precisely fits that description as well and can import from CSV files just fine.  Here’s what the data looks like once it’s in PowerPivot.  Throwing large datasets in PowerPivot will give you far better performance than storing the same data directly in a spreadsheet.

    One very powerful aspect of PowerPivot is its use of data compression.  The CSV file containing the six states’ baby data was over 20MB. The Excel workbook containing the PowerPivot model with that same data was less than 1MB.

  • Thumbnail 1
  • Thumbnail 2
  • Thumbnail 3
  • Thumbnail 4
  • Thumbnail 5
  • Thumbnail 6
  • Thumbnail 7
  • Thumbnail 8
  • Thumbnail 9
  • Thumbnail 10
  • Thumbnail 11

Topic: Enterprise Software

Kick off your day with ZDNet's daily email newsletter. It's the freshest tech news and opinion, served hot. Get it.

Related Stories

Talkback

3 comments
Log in or register to join the discussion
  • Data privacy?

    BigQuery provides big-data analytics in a completely hosted offering. Hope there is no issue on the front of data privacy. Any idea?

    - Lisa
    http://www.hireamobileappdeveloper.com/
    SaraParker23
  • BigQuery or PowerPivot

    What exactly was this article about?

    So I can load data into BigQuery using CSV, export it out as CSV, import the CSV into Excel, then use PowerPivot to actually do analytics.

    Why not just go from CSV directly into Excel? What value is BigQuery bringing to the process; other than turning over my data to Google and giving me a query interface (but not a visualization interface) that will work on an iPad?
    Marc Jellinek
    • PowerPivot or BigQuery

      @Mark, my goal was to show you how BigQuery works, and to contrast that with how you might do similar work in Excel. I wasn't suggesting that you use one and then move the output to the other, although that would work.

      When you ask "Why not just go from CSV directly into Excel?", I suppose that is one of the questions I wanted to provoke you to think about. Would you rather use something like PowerPivot + Excel on your desktop, or would you prefer to stay cloud + browser (and SQL) based and use BigQuery? What's your take? Does the cloud trump the desktop + Excel?
      andrewbrust