Yale bioethicist warns of singularity's perils at futurist gathering

By | July 9, 2010, 12:35pm PDT

Summary: The World Future Society’s yearly confab got underway last night in Boston with a keynote from Wendell Wallach, a bioethicist, lecturer and scholar at Yale University.

Last night, the World Future Society’s yearly confab got underway in Boston with a keynote from Wendell Wallach, a lecturer and scholar at Yale University. Judging by the audience of several hundred, the topic of artificial intelligence, the singularity, and their societal implications are of interest across all demographics.

Wallach is a pioneer in the nascent field of robot ethics and has captured the imaginations of futurists with his theories on artificial moral agents and computational ethics.  In fact, he designed the world’s first course on the subject at Yale, and he published a book last year entitled, Moral Machines: Teaching Robots Right from Wrong.

Wallach immediately engaged the future-hungry audience with a video clip from the opening scene of 2001: A Space Odyssey depicting man’s upright strife with a bone.  For better and for worse, man will shape technology, and in turn, it will shape man.  He said to get ready for a “wild roller coaster ride through emerging technologies.” And he delivered.

He rounded it out to a nice list of 10:

One of the first among a barrage of points Wallach made in his keynote was that Homo sapiens were not the first toolmakers, that honor goes to Homo habilis.  Additionally, we’re not the only ones to use tools pointing to the several kinds of animals that also use them. The important issue for us, however, is that we’re seeing the beginning of a co-evolution between human beings and their technologies. We now evolve culturally and are as much as product of our culture as our biology.

According to Wallach, life expectancy is growing at a rate of 1 year every 10 years. He asks, “What if we doubled life expectancy? What would the societal impact be?”  We’re now attacking death as a disease and the battle can be traced back to the in the mid-1800s when germ theory came into the fore.  A simple solution to germs is to use ordinary bar soap he remarked to the crowd’s delight.

Wallach then moved on the singularity. For the uninitiated, the term singularity is borrowed from physics and in this context means the point 20, 30 or 100 years out (depending who you ask) at which technological progress will enable computers to reproduce the same level of intelligence as humans. “The change would be dramatic that it has to be called the singularity,” he said.

Wallach is not entirely bought into the idea, however, calling himself a friendly skeptic. “We are far from understanding human intelligence and the qualities to pull this off.”  He then proceeded to parse the topic into three areas: complexity, thresholds, and societal/ethical implications.

Reaching the computational ability of the human brain is within sight, but there are other things about the brain that can’t be overlooked. For instance, it is engaged in massive parallel processing and extensive looping, and we don’t know how it self-organizes. If you damage the brain, there is limited degradation, but with a desktop, if one bit is out of place, your computer locks up.

The thresholds to human-level computer intelligence include things like vision, language, and locomotion, which are well on their way, said Wallach.  But there’s a science of consciousness that has emerged.  “Why do we experience anything at all? You need to be conscious to know semantics. We don’t understand if consciousness is unique to carbon-based systems,” he explained.

Also consider that humans are comprised of thousands of interlinked subsystems which are required for us to function the way we do.  If not, we have mental breakdowns and get disease.  Can you replicate this kind of complexity with a computer?

The next segment in the presentation focused on where are we today with computers and how we’ll progress from here to the singularity.

Computers today are limited to specific functions. But researchers are now mapping a new field of inquiry into Artificial Moral Agents, the implementation of moral decision-making faculties in artificial agents so that they have basic ethical sensitivity.

“We are in the midst of huge change,” he said, pointing to the robotization of the military. “By 2050, 1/3 of all ground and air vehicles will be unmanned…is this a good idea or a recipe for future disasters?

These machines have operational morality. In other words, they have values of the designs or corporations that build them. But we are moving into an area where robots need to evaluate decisions. There are three approaches:

Wallach discussed the role of ethical theory in defining the control architecture of robots, first by noting the shortcomings of Isaac Asimov’s 3 laws of robots, quipping that they’re a nice literary device. “Humans are a biochemical instinctual, emotional platform while computers are rational from the get go,” he said.

Robots that take care of the elderly, for instance will need to use ethics and react to say the terror of a patient, maybe caused by the robot itself.

Driver-less cars sounds like a good idea and many people say it will solve many problems like traffic congestion and the death-rate on the road.  Although traffic deaths may decrease substantially, accidents will still occur, therefore, corporations will simply not build them because of the liability issue. They need insurance.

Wallach continued his 1.5 hour long address covering human enhancement technologies, saying that it’s hard to separate the promise from the perils and bringing up the societal issues. “Is this an evolution or a devolution…do we really need to improve who we are.”

He followed that with a risk assessment saying that the tools we have are very weak. As for the public policy challenge, Wallach said we are addressing these challenges piecemeal, and that may be ok, but the problem is that nobody asked if it really is ok.

The presentation concluded with a look at research ethics. He asked if we should lower or raise the barriers for using human subjects and if we should allow for enhancement research. “Our challenge is to find the middle way that works for all humanity,” he said.

His final point: The more autonomy we put on the machine, the more responsibility is put on the human. So we are moving in a circle that is self-defeating.

Kick off your day with ZDNet's daily e-mail newsletter. It's the freshest tech news and opinion, served hot. Get it.

Topics

Christopher Jablonski is a freelance technology writer.

Disclosure

Chris Jablonski

Christopher Jablonski has no business relationships, affiliations, investments, or other actual/potential conflicts of interest relating to the content posted so far on this blog.

Biography

Chris Jablonski

Christopher Jablonski is a freelance technology writer. Previously, he held research analyst positions in the IT industry and was the manager of marketing editorial at CBS Interactive. He's been contributing to ZDNet since 2003.

Christopher received a bachelor's degree in business administration from the University of Illinois at Urbana/Champaign. With over 12 years in IT, he's an expert on transformational technologies, particularly those influential in B2B.

Talkback Most Recent of 6 Talkback(s)

  • RE: Yale bioethicist warns of singularity's perils at futurist gathering
    "We now evolve culturally and are as much as product of our culture as our biology."

    More like "devolve" since we've been basically been banishing moral beliefs due to their religious connections.

    "For the uninitiated, the term singularity is borrowed from physics and in this context means the point 20, 30 or 100 years out (depending who you ask) at which technological progress will enable computers to reproduce the same level of intelligence as humans."

    I'd say it's further out than even 100 yearsm if at all. AI is one of those areas filled with speculation about things that are supposedly near future, but never materialize.

    "We are far from understanding human intelligence and the qualities to pull this off."

    Bingo. We can't even understand it ourselelves, yet we predict it will happen in our lifetimes? That's a pretty silly assertion.

    "The thresholds to human-level computer intelligence include things like vision, language, and locomotion, which are well on their way,"

    I'd say a lot of them are already here - we just haven't a clue how to piece them together, or how they fundamentally interact with intelligence.

    "These machines have operational morality. In other words, they have values of the designs or corporations that build them. "

    Considering how much controvery there is over human morals (and there's even controversy on how you define the term), I'm not certain it's wise to attempt to create a machine that tries to reason morally. And even if we can agree on what makes a machine "moral," there's the next question of whose morals we put in it. Not to mention the question of how it will interact with religions, and even whether it has its own religious beliefs.

    "In a Democratic society the public should give at least tacit approval to the future it is creating"

    No.

    I absolutely do not think that technologies should have absolute free reign over our society, sorry. We know that technology can be just as destructive as it can be constructive. Look at the history of warfare if you don't believe me.

    I son't think we should be investing in technologies that bring us to destruction - I'd rather we exist in the stone ages or exist in a state of frozen tech then to stop existing at all.

    Hopefully we can make progress wihtout risking our existence - but if we have to make the tough choice of whether we continue down a path that could lead to our destruction, I'd very much not proceed down that path.

    I love technology, and I love what it can do for us, and I'm very excited to be a part of this. But I love the human race even more. I'd give up all the technology in the world if that's what it takes to prevent us from destroying ourselves.
    ZDNet Gravatar
    CobraA1
    10th Jul 2010
  • All of this has happened before....
    I think Battlestar Galactica just took one huge step closer to becoming reality than fiction.
    ZDNet Gravatar
    Cylon Centurion
    10th Jul 2010
  • RE: Yale bioethicist warns of singularity's perils at futurist gathering
    Biodiversity is directly related to human health. We are now in our sixth extinction, for several decades, called the Holocene extinction, caused by man. Nanotech and Genetic Engineering are so far removed from ecology and have the potential to wipe man off the face of the earth because all the hard scientists, that is the chemists and physicists, generally do not consider the waste stream and where all this technology returns when discarded and used. That end point is the ecosystem that supports biodiversity. If we keep worshiping future tech without knowledge of ecology, all of us, we simply are not going to make it as a species, with or without these fancy new technologies. We still have yet to understand the old fashioned ecology that sustains us. It is pure hubris to introduce these new technologies into the ecosystem so quickly. No one knows the long term consequences of the introduction of nanotech and the like, just like when we introduced invasive species without knowing the intended consequences. Slowing down with caution is not our strength. There is simply too much money to be made to be cautious. Who will pay in the end when this stuff ends up in our waste stream, the ecosystem? Humanity. I feel so strong about this, I decided not to have children, the odds are they will be the ones to pay, and so will yours. No one listens to the life scientists, only the tech scientists. This will be our doom down the road. Get the opinions of all the life scientists you can. High tech doesn't want to hear this.
    ZDNet Gravatar
    MeisterPresentMoment
    14th Jul 2010
  • RE: Yale bioethicist warns of singularity's perils at futurist gathering
    @MeisterPresentMoment
    Thanks for your post.Although biodiversity is an indispensable topic for the future of ourselves,it has several negative effects to very future of ourselves as well.All this scientific breakthroughs must be advanced with the comprehension of ecology.Because what made us as a human comes from this ecology.We are dependent to our habitat therefore any slight change in the equilibrium of natural environment will directly effect us.Technological breakthroughs should be compatible with environmental rules.In addition, i want to say that i share Meister Present Moment's thought of not bringing a children to this messed up world.
    ZDNet Gravatar
    dusunsel
    23rd Jul 2010
  • RE: Yale bioethicist warns of singularity's perils at futurist gathering
    @dusunsel "i want to say that i share Meister Present Moment's thought of not bringing a children to this messed up world."
    This is exactly how I feel. I think about life and the world all day every day in one way or another and I had so much anxiety at one point and realized it was because I was afraid that when I had a child, the seeds of irreversible destruction already planted would be the fruit that it would inherit. I decided that with the trajectory our species is on, it would be immoral for me to bring a life into earths near future. After making that life decision I felt a huge weight lift off of me. Not all the weight because I care deeply for the plight of those who are here already and friends who will have children, but knowing that no matter how horrible things become it will end with my last breath and no human life bearing my genes will be subjected to our societies disgusting irresponsibility as stewards of the earth. As an aside, I will also be avoiding birthing another American whose global footprint is a pox on the world no matter how hard they try to mitigate it.
    ZDNet Gravatar
    biffjenkins
    4th Aug 2010
  • RE: Yale bioethicist warns of singularity's perils at futurist gathering
    I used to be able to daydream and probe the moral implications that things like the Singularity carry with it, but the last few years I've immersed myself in studying recent world geopolitics and systems of authority we're forced to live under and I can't even pretend to think that mankinds future will be high tech. We've passed the point of no return on a lot of ecological fronts and so much of the populace have given into the behavioral controls society saturates them with, that by the time we realize we need to change our priorities, those with money and power will be firmly entrenched and free to fight over the last of our potable water, fossil fuel and arable land (using us for the ugly work). Things that should have been discussed in vast detail in public forums with government support regarding things like ethics in our modern society and what kind of world we want to live in, wont ever happen. Everything is political theater now. We already produce enough food to feed the entire planet adequately. The only things stopping that from happening are monied interests, logistics (which is very solvable) and apathy. Profit is the new morality. people starve while farming land for companies that ship the food out of the locality. The government pays corporate farms to destroy excess crops so that the market doesn't become saturated, lowering profit margins. Small nations are strong armed into letting multinationals privitize their water rights in exchange for things like delaying interest payments on manipulative loans. the IMF and World Bank punish countries for allowing peasant farmers to operate outside of the Globalism paradigm and dare to refuse GMOs or seeds from Monsanto.
    If we see any intelligent robots in the future they will have Raytheon logos, pain rays (http://en.wikipedia.org/wiki/Active_Denial_System), and rights current police would drool over.
    ZDNet Gravatar
    biffjenkins
    4th Aug 2010

Talkback - Tell Us What You Think

Formatting +
BB Codes - Note: HTML is not supported in forums
  • [b] Bold [/b]
  • [i] Italic [/i]
  • [u] Underline [/u]
  • [s] Strikethrough [/s]
  • [q] "Quote" [/q]
  • [ol][*] 1. Ordered List [/ol]
  • [ul][*] · Unordered List [/ul]
  • [pre] Preformat [/pre]
  • [quote] "Blockquote" [/quote]

The best of ZDNet, delivered

ZDNet Newsletters

Get the best of ZDNet delivered straight to your inbox

Facebook Activity

White Papers, Webcasts, & Resources