'Mask-bot' gives robots a human face

'Mask-bot' gives robots a human face

Summary: Robotics researchers in Munich have developed a new robot face that displays realistic 3D heads on a transparent plastic mask, opening a new frontier in human-machine communication.

TOPICS: CXO, Emerging Tech

Credit: Uli Benz / Technical University of Munich

A team of researchers at the Institute for Cognitive Systems (ICS) at TU München have collaborated with a group in Japan to develop Mask-bot, a 3D image of a human face projected onto the backside of a plastic mask, creating very realistic features that can be seen from various angles, including the side. "Mask-bot will influence the way in which we humans communicate with robots in the future," predicts Prof. Gordon Cheng, head of the ICS team. One key distinction between comparable approaches to three-dimensional heads, note the researchers, is that rather than using a front projection, Mask-bot uses an on-board rear projection to ensure a seamless face-to-face interaction. The projector uses a high-compression fish-eye lens to spread the beam to a wide angle while a macro adapter shortens the focal distance to the transparent mask roughly 4.7 inches away. Mask-bot can create facial expressions and simple dialog. For instance, when you say "rainbow", Mask-bot flutters its eyelids and responds with: "When the sunlight strikes raindrops in the air, they act like a prism and form a rainbow." And when it talks, it also moves its head a little and raises its eyebrows to create a knowledgeable impression.

Is this the remote boss of the future? (Credit: Jeff Bots)

Mask-bot comes with additional bells and whistles. It is bright enough to function in daylight thanks to the strong projector and coating of luminous paint sprayed on the inside of the plastic mask. This aspect means that it can potentially be used in video conferencing. "Usually, participants are shown on screen. With Mask-bot, however, you can create a realistic replica of a person that actually sits and speaks with you at the conference table. You can use a generic mask for male and female, or you can provide a custom-made mask for each person," explains Takaaki Kuratate, creator of the Mask-bot. Mask-bot doesn't need a video image of the person speaking in order to work. A program converts a normal two-dimensional photograph into a correctly proportioned projection for a three-dimensional mask. Additional algorithms add in voice and facial expressions based on a motion capture system. Finally, Mask-bot can realistically reproduce content typed via a keyboard--in English, Japanese and soon German--using a text-to-speech system. It can produce a female or male voice, which can then be set to quiet or loud, happy or sad, all at the touch of a button.

Compared to mechanical faces which require dozens of actuators and compressors to appear lifelike, Mask-bot will be able to combine expression and voice much faster. Mask-bot 2, the next generation of the prototype will see the mask, projector and computer control system all contained inside a mobile robot, say the Munich researchers. The cost for the new version will also drop from about EUR 3,000 ($4,123) to EUR 400 ($550). Besides video conferencing, "These systems could soon be used as companions for older people who spend a lot of time on their own," said Kuratate.

Topics: CXO, Emerging Tech

Kick off your day with ZDNet's daily email newsletter. It's the freshest tech news and opinion, served hot. Get it.


Log in or register to join the discussion
  • RE: 'Mask-bot' gives robots a human face

    That's very cool! It actually looks very convincing. The robot looks a little red-cheeked and angry though ;D
  • RE: 'Mask-bot' gives robots a human face

  • RE: 'Mask-bot' gives robots a human face

    Instead of recreating a human face how about an AI. They should create a standard AI face for robots and AI so that it is less creepy, more recognizable as not-human-but-AI. that way the public can start getting used to them and recognizing them. Eventually they will probably be branded like Sony and Honda and IBM.
  • RE: 'Mask-bot' gives robots a human face

    Ray Harryhausen used basically the same trick in the original <i>Clash of the Titans</i> to make the head of a statue appear to "come to life" and prophesy - projected footage of Maggie Smith delivering the lines onto the face of a many-times-life-size sculpted bust of herself.
  • RE: 'Mask-bot' gives robots a human face

    Waiting for Adam Selene, or someone like him...
  • This was borrowed from Disney

    They've been doing this for 50+ years
    • RE: 'Mask-bot' gives robots a human face


      The researchers acknowledge the pioneering efforts of Walt, but they note that in his Haunted Mansion, he projected images of grimacing actors onto busts from the front.

      • RE: 'Mask-bot' gives robots a human face

        @christopher_jablonski But in Buzz Lightyear, it's a rear projection.
  • RE: 'Mask-bot' gives robots a human face

    Doesn't look like they did a very good job. The robot's mouth looks nothing like a human mouth when talking. And the eyes are expressionless. This article hypes it up when in reality it's quite a poor representation of a human.
  • And?

    And we need such tech for what exactly?
  • RE: 'Mask-bot' gives robots a human face

    I could barely hear the speaking over the motor noises.
    I'm surprised that these AI faces never smile. Surely the technology exists to create a friendly expression on them.
    Garrett Williams