Visions of cloud computing and Web 2.0, circa 1990s: the world catches up to Yale's David Gelernter

The question is not 'What can software engineers build?' but 'What do users need?'

"Computing transcends computers. Information travels through a sea of anonymous, interchangeable computers like a breeze through tall grass. A desktop computer is a scooped-out hole in the beach where information from the Cybersphere wells up like seawater..." -David Gelernter, The Second Coming: A Manifesto, 2000

In a new and powerful interview from Edge Foundation, Yale scientist David Gelernter was joined by John Markoff and Clay Shirky in an inspiring discussion of Gelernter's prescient visions of cloud, Web 2.0, and Semantic Web -- years before anyone else was talking about them -- and where we're going with technology. (With a trio like this, you know it's going to be good....)

The question is not 'What can software engineers build?' but 'What do users need?'

Gelernter himself has always been a step or two ahead of the industry, publishing the book Mirror Worlds: or the Day Software Puts the Universe in a Shoebox...How It Will Happen and What It Will Mean in 1991, which predicted the rise of the World Wide Web among other things. In his 2000 work, pulished at Edge, The Second Coming: A Manifesto, he predicted the rise of cloud computing. As he explained in the recent interview:

"The central idea we were working on was this idea of de-localized information — information for which I didn't care what computer it was stored on. It didn't depend on any particular computer. I didn't know the identities of other computers in the ensemble that I was working on. I just knew myself and the cybersphere, or sometimes we called it the tuplesphere, or just a bunch of information floating around. We used the analogy — we talked about helium balloons. We used a million ways to try and explain this idea."

Gelernter also discussed his original vision (circa 2000) of the rise of the Semantic Web and advanced search, which he called "lifestreaming," in which all the documents and data that are part of your existence you need are retrievable at any time, on demand.

In preparing his initial work for Mirror Worlds, Gelernter said he had reservations about the idea of information being stored and managed across interconnected computers, wondering if it was a "stupid" idea that "would never work." (This was 1991, after all.) "It is grossly inefficient. There is no way that you can take information, just float it out there, and expect people to search this whole vast collection, or somehow or other find what they want. And, you know, how are you going to find out what computer to put it on? How am I going to know what computer to look for it on?"

He says as he gained experienced and continued to research the problem, he determined that "In the final analysis, "the question is not, what can software engineers build? It's the question, What do users need? If we identify our user need, the software technology will come along — in combination with hardware, obviously, and interconnect technology."

In the interview, Markoff mentioned that many people appear to be abandoning their "fetish" for computers, as the emphasis has shifted to the world of information and content that is accessible via the Web.

"Easily half the world doesn't like playing with machines," Gelernter said. "It's not something they enjoy doing. It's not something they take to." He added that the mission of the computer industry itself is shifting, albiet begrudgingly: "What are we looking for and should we have computers in mind, or should we have software in mind, or should we have actual users in mind? I think the average programmer still doesn't understand that he is not a typical user. The average programmer still thinks that insofar as people don't find his software easy to use, it's because they are childish, or ignorant, or just obtuse."

The original work of Mirror Worlds may be 18 years old, but, as Markoff put it, "the world is just now catching up with that.... It's clear now with cloud computing that that's the direction the world's moving in. But only now."

Gelernter says the only major fault with his earlier predictions were that they were "too conservative."

HT: JP Rangaswami ("Confused of Calcutta").