Business Analytics: Do we need data scientists?

Moderated by Lawrence Dignan | May 13, 2013 -- 07:00 GMT (00:00 PDT)

Summary: In a world where data drives everything, do we need data scientists to make sense of this tidal wave of information?

Robin Harris

Robin Harris

Yes

or

No

Andrew Brust

Andrew Brust

Best Argument: Yes

56%
44%

Audience Favored: Yes (56%)

Closing Statements

Cutting edge requires cutting edge skills

Robin Harris

People are all in favor of change except for the change part. The change here is that big data requires new skills and new ideas to fully exploit it.

Whether we embrace this or fear it probably has more to do with our individual natures than the fact of big data and data science. The name we give these people is much less important than the societal value of their skills.

Perhaps, someday, the Watson Mk. XXXXII will be able to ingest huge data sets and make sense of them. But until then the cutting edge of big data will require people with a wide skill set to mine the economic value of big data.

 

Specialists don't scale

Andrew Brust

Big data technology is powerful, and it keeps getting better. But the technology does, right now, require niche specialists to derive the greatest business value from it. These specialists have to be renaissance people – possessing a combination of technology, mathematics and business skills, and knowledge. It’s not clear that being so clever and versatile makes these specialists into “scientists,” but it does make them rarefied.

Nonetheless, for big data and analytics implementations to grow and become truly mainstream, having such diverse skill set requirements for them is not a sustainable situation. Market need is going to drive evolution in the technology such that the barrier to entry will not be nearly so high as it is now. If for some reason that didn’t happen, then adept use of big data would continue to be an option open only to a relatively small group of customers.

So the solution to our problem isn’t legions of new data scientists. Instead, we need self-service tools that empower smart and tenacious business people to perform big data analysis themselves. The specialists will still have an important role, but they won’t be the thing that scales big data across industries.

Big data for the masses

Lawrence Dignan

This argument boiled down to timelines in many ways. Today, we need more data scientists, but in the long run big data has to be for the masses of workers.

Specialists only go so far, argued Andrew Brust. Robin Harris argued that we need more data scientists. In the end, Brust had a better argument. Data scientists are important, but you may not need an army of them to boost the analytics revolution.

Ultimately, we're going to need data scientists, innovative user interface and a lot more data literacy from average workers.

Talkback

22 comments
Log in or register to join the discussion
  • Knowledge Workers Need to Become Data Scientists or They Should Hire One

    The data scientist is a crucial resource for corporations dealing with massive data. A data scientist is a knowledge worker that knows how to tap into data using the tools we have today. Knowledge workers don't usually have the complete skill set to leverage today's analytical tools.

    As for the argument that analytical tools need to evolve, the only way an analytical tool will "evolve" is if it is built specifically to analyze a specific data set in a specific way. In other words, someone needs to tell the tool how to think and how to analyze the data, which limits the scope and usefulness of the tool. For data scientist not to be needed, each company will have to build it’s on set of BI tools to perform the specific analysis it is trying to do.

    So you can hire a set of developers to build single purpose tools, or you can hire data scientists to work with the tools available today. (Either way it is going to cost you!) General tools designed to work with general data will never "evolve" and will always need a data scientist to harness their power.
    callmemed
    Reply Vote I'm for Yes
  • It's the Data Economy Stupid

    Maybe they are scientists, or really good data analysts, but the bottom line is simple: In order to do "big data," meaning forward-looking analytics, predictive and/or discovery, you need to have some people that (a) really understand the data, and (b) really understand statistics. Despite heroic attempts at more sophisticated visualization by the likes of Tableau Software, SAS, and most recently SAP to bring big data "ease of use" to the common business analyst or user, the really high-value stuff requires an expert. Organizations that want to enjoy positive economic impact from big data will need some experts.
    ebquinn
    Reply 1 Vote I'm for Yes
  • In the world of Computer Science, we would say ...

    ... that your business needs people trained in, and familiar with, Data Structures. The old saying "garbage-in, garbage-out" applies here. When businesses first move their data into an on-line database, they store it as if it is still on paper. Well, sorting electronic "sheets of paper" is no more efficient than sorting physical sheets of paper.

    The larger the organization, the more important it is that your IT department have on-staff people who not only know how the business works, they need to know how all of the data the business depends upon is related to each other. If that is not well understood, your DBMS (database management system) will be no better than that file cabinet full of sheets of paper stored in folders.
    M Wagner
    Reply 1 Vote I'm for Yes
  • It may be more common than you think.

    "The required skill set is real and uncommon"

    It may be more common than you think.

    Just because somebody doesn't use the exact words "data scientist" on a resume doesn't mean he/she doesn't have the skill. The vast majority of computer scientists are taught a wide variety of skills related to information theory, database programming, statistics, and other skills useful for "data science."

    I'm willing to bet there's actually plenty of "data scientists" out there, it's simply that employers don't know where to look.
    CobraA1
    Reply Vote I'm Undecided
  • I don't know about "data scientists"

    But you certainly need people who understand logic and statistics - and there are not many of these people about.
    jorwell
    Reply 2 Votes I'm Undecided
  • How can any logic support "no"?

    It is like asking: "Do we need teachers?" or "Do we need doctors?" or "Do we need software engineers?"

    "We don’t need data scientists, we need tools that empower knowledge workers to do big data analytics on their own."

    Is a cop-out of someone that has no knowledge that these tools are derived, developed and modeled by "shamans" with extensive knowledge of math, probability, statistics and the current business models driving the data. These are combined to create models and the models are then tested and rolled into tools. Take away the data scientist and you are left with a 1990's database and nothing more.
    Bruizer
    Reply 2 Votes I'm for Yes
    • Specialists

      +1. Mr. No doesn't get it; he thinks a tool as easy (or probably easier) to use as MS Excel should be created so Mom and Pop can DIY their own big data. The Data Scientist is a specialist, just like other fields.
      beau parisi
      Reply 1 Vote I'm Undecided
  • Data Science has always been with us and is more important than ever

    No matter what you call the person, those who use probability and statistics to help us continue past success and avoid past failure will always be important and useful to any organization with analyzable data, and that is especially true with ad model online publishing where targeted marketing of whatever is more critical than ever.
    nevinhouse@...
    Reply Vote I'm for Yes
  • Analysis and analytics

    While it is true that, as we gather more and different varieties of data, we need tools to extract, interpret and assemble them - often buried in the term "analytics" - analysis is quite a different beast. The simplest form of analysis could be spotting "outliers" - the highest, the lowest, the most expensive, the least expensive etc. Then we move to statistical analysis using various regression approaches. But to go beyond that requires ingenuity and expertise that defy simple categorization.

    It's worth looking at the development of economics during the last 60 years. There were the mathematical models of studying correlations that started the craze of econometrics. But very soon we started to see sophisticated applications from linear programming and game theory being used in models. Would you call these people "data scientists?" Modelers, perhaps. Economists, definitely. Often they are, like, John Nash, mathematicians, or like Daniel Kahneman, psychologists. Once data is generally accessible then experts from other fields can also bring their special analytical skills to bear on the topics - and the field will evolve. Could Economists on their own developed the Game theory of Von Neuman? Perhaps. But it is unlikely since their education does not include such mathematics.

    In short, prescribing the skills when we don't even know where the field is moving is not prudent. Just make the data available and the people with skills will come. Once the field stabilizes then we can replicate skills through appropriate training. Innovation is not the result of training.
    Jkuriyan@...
    Reply Vote I'm Undecided
  • The tools are easy

    The real work of a data scientist is putting the data together from different sources and to clean the data. Tools will not do it for you, there are too many variables. So either you can wait until the tools and AI is ready to do the job and see your business falling far behind the competition, or you pay someone and stay current with your business.
    nicopretorius
    Reply 1 Vote I'm for Yes