In this podcast interview, I talked with Pell about his views on AI and how the development of machines smarter than humans will play out in coming decades. We also discussed the underpinnings of Powerset as an example of technology and collective human intelligence applied to making a smarter search engine, and how natural language understanding is at an inflection point, moving out of the labs and into the world.
Pell said that AI entities will get smarter but also humans, via intelligence augmentation, will gain new capabilities. He suggested that two approaches will meet in the middle--bottom-up complete brain simulations, which develop like human children, and top-down engineered systems.
He provided a framework for thinking about how AIs might evolve, and thoughts about the risks in developing such advanced technologies. "We are going to have to just bite the bullet--because this is going to happen. I don't think these will be technologies you will be able to control. I do think there is strong value in looking at what are architectural aspects that may or may not be the same as people that can really dispose these systems to be the kinds of systems you want to build and to look at training and development processes that socialize these systems in the right way," Pell said.
See also: Steve Omohundro: Building self-aware AI systems
Steve Jurvetson: AI, nanotech and the future of the human species
Can ‘friendly’ AI save humans from irrelevance or extinction?