MIT researchers create bidirectional LCD screen that allows Minority Report-style interaction

Summary:MIT researchers have created a working prototype of a bidirectional LCD that allows a viewer to control on-screen objects without touching the screen.

Researchers at the Massachusetts Institute of Technology have created a working prototype of a bidirectional LCD that allows a viewer to control on-screen objects without touching the screen.

The bidirectional LCD screen, which captures and displays images, eliminates the need for any external controllers or touch contact. Hello, Minority Report.

Ramesh Raskar, Matthew Hirsch and Henry Holtzman created the prototype at MIT's Media Lab along with Douglas Lanman of Brown University.

Called the BiDi Screen ("bye dye," short for bidirectional), the device works by building on traditional touchscreen input. That technology works by using arrays of optical sensors that are interlaced with a panel’s pixels to detect multiple points of contact with the surface.

But to incorporate air gestures instead of simply touch, the researchers added a sensor layer of photodiodes behind the liquid crystal layer.

The LCD screen can switch between display mode -- serving as a backlit LCD display, just like your computer monitor or television -- and capture mode, where it can detect air gestures, in real time.

In capture mode, the screen functions like a pinhole array to capture the angle and intensity of light passing to the sensor layer (the backlight is disabled). By correlating data from multiple views across the sensor array, the system images objects -- such as your hands -- that are located beyond the display surface to determine their distance from the display.

Add software to pair air gestures with on-screen objects, and you've got yourself Minority Report-style interaction.

Here's a video of the technology in action:

The researchers said they designed the display to operate within the limits of consumer off-the-shelf technology. It's reasonably thin, too, despite the extra layer of cameras.

The potential harbored by the technology could forever change the way we interact with our electronic devices, from phones to televisions, according to the researchers.

This post was originally published on

Topics: Innovation


Andrew Nusca is a former writer-editor for ZDNet and contributor to CNET. He is also the former editor of SmartPlanet, ZDNet's sister site about innovation. He writes about business, technology and design now but used to cover finance, fashion and culture. He was an intern at Money, Men's Vogue, Popular Mechanics and the New York Daily Ne... Full Bio

zdnet_core.socialButton.googleLabel Contact Disclosure

Kick off your day with ZDNet's daily email newsletter. It's the freshest tech news and opinion, served hot. Get it.

Related Stories

The best of ZDNet, delivered

You have been successfully signed up. To sign up for more newsletters or to manage your account, visit the Newsletter Subscription Center.
Subscription failed.