The AI, machine learning, and data science conundrum: Who will manage the algorithms?

Artificial intelligence and machine learning are being adopted into the enterprise at a rapid clip and adoption is likely to surge in 2019. What comes next is the real business challenge: How will we manage technology that we likely don't understand?

The issue is likely to bubble up in the year ahead. For now, most of us are lulled into thinking more algorithms are better and even assuming we can outsource critical thought to models. Why hurt our brains when we can trust Einstein, Watson, Alexa, Google Assistant, and other software tools to think for us?

Primers: What is AI? Everything you need to know about Artificial Intelligence | Machine learning? | Deep learning? | Artificial general intelligence?

According to IDC, global spending on AI and cognitive technologies will reach $19.1 billion in 2018, up 54.2 percent compared to a year ago. By 2021, AI and cognitive spending will hit $52.2 billion. If you're not spending on AI, you may need some computer-assisted help to set your budget.

Here's a look at the top use cases from IDC.

And here's a reality check: Not all of these AI implementations are going to go well. Why? Managing AI may be one of the biggest business challenges in the year ahead. AI will be like most enterprise technologies -- ERP, CRM, HCM, blah, blah, blah -- and fail to be a magic bullet.

Consider the following moving parts:

1. Every business technology leader needs an artificial intelligence and machine learning strategy. Why? The board is asking.
2. In response to this demand, cloud providers such as AWS, Microsoft, and Google are starting to package AI services to address horizontal functions such as recommendations, contact center and HR recruiting. Those moves will make AI easier to consume.
3. There is a shortage of data scientists available to truly kick the tires on models and algorithms. A few companies I've talked to have a data science team to put AI tools through their paces, but most don't.
4. There is little transparency in the models being sold, inherent bias, or fine print. IBM Research recently proposed an effort to add the equivalent of a UL rating to AI services. IBM Research is on target.
5. Universities are adding data science programs to business schools, but these students won't become C-level executives for a while.
6. As technology buyers we are trained to buy black boxes that will fix our problems and offer us "solutions."

That list is a lot to digest. Rest assured we're going to get a collective case of AI implementation indigestion due to algorithm sprawl, project management issues, and vendor hype. We're also likely to hit Gartner's trough of disillusionment soon. Maybe even tomorrow.

Gartner's Emerging Technology Hype Cycle has AI all over it. Gartner is betting that AI technologies such as AI platform as a service (PaaS), Artificial General Intelligence, autonomous driving, conversational AI platform, deep neural nets, and virtual assistants will be mainstream in the next two to five years. According to Gartner, AI technology will be "virtually everywhere over the next 10 years."

As far as marketing goes, AI is already everywhere.

Also: Free PDF download: Data, AI, IoT: The future of retail

The trick will be figuring out how everyone from mid-level managers to C-level execs are going to use this AI and manage what they aren't likely to fully understand. The real fun is just starting.

More AI:

• Inside the black box: Understanding AI decision-making
• Time to break open AI's black box, and keep it open
• AI chips for big data and ML: Hard choices in the cloud and on-premise
• Infographic: Half of companies plan to use AI, but haven't worked out the details
• Five ways your company can get started implementing AI and ML
• Why AI and ML need to be part of your digital transformation plans
• Should Amazon be your AI and machine learning platform?
• Should Google be your AI and machine learning platform?
• Should Microsoft be your AI and machine learning platform?
• Should IBM be your AI and machine learning platform?

How ubiquitous AI will permeate everything we do without our knowledge.

ZDNet's Monday Morning Opener

The Monday Morning Opener is our opening salvo for the week in tech. Since we run a global site, this editorial publishes on Monday at 8:00am AEST in Sydney, Australia, which is 6:00pm Eastern Time on Sunday in the US. It is written by a member of ZDNet's global editorial board, which is comprised of our lead editors across Asia, Australia, Europe, and North America.

Previously on Monday Morning Opener:

• Why Facebook is powerless to stop its own descent
• GOAT uses machine learning, computer vision to verify your top dollar sneakers
• Windows 10: Swapping the big bang for the long grumble
• Report from an almost cashless society
• The 4 hottest tech trends that are transforming the world in 2018
• How Fortnite approaches analytics, cloud to analyze petabytes of game data
• Blockchain and bluster: Why politicians always get tech wrong