IBM has formed a cognitive systems unit under its hardware umbrella in a long-term move that aims to speed up Watson training time with integrated systems that'll produce insights almost in real-time.
The unit, which launched February 1 under senior vice president Bob Picciano. is charged with using IBM's research, Power architecture and ecosystem via OpenPower to create systems better prepared to navigate unstructured data, machine learning and artificial intelligence.
"The economic value metrics for hardware are changing. We're moving from programmatic, procedural and transactional in nature to valuing computer systems on insight. How do I get insight out of workloads?" said Picciano. "Computing architecture needs to fundamentally change."
Picciano said that IBM started changing its Power processor architecture about 5 years ago. Like most technologies in IBM's portfolio, so-called cognitive systems will touch multiple divisions. There will be ties to Watson, cloud computing, software and services. IBM's systems for cognitive computing will be used in the company's own cloud as well as for customers building their own infrastructure, said Picciano.
Add it up and it's clear that IBM is looking to its hardware unit to boost Watson adoption as well as boost growth. For instance, IBM's systems division is one of its smallest units and hardware sales for 2016 fell 22 percent from the previous year. However, IBM is betting that hardware is fundamentally changing and reckons that cognitive, AI and analytics systems will grow from a $1 billion market to $4.6 billion in 2019.
Here's a look at the key points from my conversation with Picciano.
Why hardware? In many respects, a hardware unit tied to analytics and artificial intelligence is counterintuitive. After all, won't most of these workloads be handled in the cloud? Picciano said that analytics, cognitive computing and artificial intelligence will be consumed in multiple channels. "One thing I know is that our clients and data scientists are all experimenting and have initiatives," said Picciano. "And they are looking for the best infrastructure on-premises and in the cloud." Memory enhancements, advances in graphics processing units, interconnects and bandwidth all provide building blocks for better cognitive possibilities.
What's the role of OpenPower? Picciano noted that IBM opened up its Power architecture and forged an ecosystem with more than 300 partners because advancing the hardware cause requires partners. Partners like Google, Mellanox and Nvidia all provide innovation for the Power ecosystem, he said. OpenPower is also critical to offering specific high performance computing knowhow for genomic workloads and the like. In addition, there are a lot of industries involved with OpenPower and they're all looking to bring analytics to data. "OpenPower is a great way to bring in other cloud leaders. It's innovation protection," said Picciano.
Why a new architecture? Part of IBM's cognitive play revolves around upending Intel's dominance. Picciano argues that IBM's optimized hardware approach will enable systems to better handle neural networks, deep learning and training systems to use inference. "This is the first inning of a longer game," said Picciano, who noted that a 10x improvement in training cycles is an early goal. "When you go to the edge of computing and IoT we want training cycles to be instantaneous with continuous inference and predictive recommendations."
Here are a few key takeaways: