X

Photos: Microsoft's OmniTouch - The tech that turns any surface into a touchscreen

The world at your fingertips...
By Nick Heath, Contributor
40154692-1-610-omnitouch-1.jpg
1 of 9 Microsoft Research/CMU

OmniTouch

The world at your fingertips...

Researchers from Microsoft and Carnegie Mellon University have shown off technology that can turn any surface into a touchscreen.

The OmniTouch is a wearable device that projects a graphical user interface, such as a computer desktop or a virtual keypad, onto any surface, from a table to a hand. Users can interact with these virtual interfaces using their fingers, which are tracked by sensors built into OmniTouch, in the same way they would use a touchscreen.

The prototype technology is on display at UIST 2012, the Association for Computing Machinery's 24th Symposium on User Interface Software and Technology, that is being held in Santa Barbara, California.

40154692-2-610-omnitouch-2.jpg
2 of 9 Microsoft Research/CMU

Omnitouch

OmniTouch is designed to be wearable. The prototype is a shoulder-mounted device made up of a laser-based pico projector and a depth-sensing camera, similar to that found in the Microsoft Kinect.

The OmniTouch uses the depth-sensing camera to build a graphical model of the world which allows it to calculate how far away objects are. The system's software can recognise fingers, and a depth map allows it to determine whether a finger is touching a surface. When a finger touches a surface onto which an interface is projected, users can interact with the screen, clicking buttons or dragging icons, in the same way they would with any other touchscreen.

40154692-3-610-omnitouch-4.jpg
3 of 9 Microsoft Research/CMU

Omnitouch

The ability of the system to track finger movements allows it to support a wide range of gestures, such as drawing with fingers, as seen here.

40154692-4-610-omnitouch-resize.jpg
4 of 9 Microsoft Research/CMU

Omnitouch

The system can be set up to allow users to create touchscreen interfaces on any surface. For example, the system could be configured to recognise a finger being dragged diagonally, as seen here, as a gesture telling it to create a new interface on that surface. The size of the interface would correspond to the distance the finger is dragged.

40154692-5-610-omnitouch-map.jpg
5 of 9 Microsoft Research/CMU

Omnitouch

Because the system can trace the movement of fingers on any surface, it can be set up to recognise gestures such as pinch-zooming on a map.

Microsoft Research Redmond researcher Hrvoje Benko said in a statement: "We wanted the ability to use any surface.

"Let the user define the area where they want the interface to be, and have the system do its best to track it frame to frame. This creates a highly flexible, on-demand user interface."

40154692-6-610-omnitouch-10.jpg
6 of 9 Microsoft Research/CMU

Omnitouch

Another potential use for OmniTouch is tracking the movement of fingers to highlight text in a printed document.

40154692-7-610-omnitouch-final1.jpg
7 of 9 Microsoft Research/CMU

Omnitouch

In this picture, the user is selecting apps from a menu on his hand which are then run on the interface projected onto the table.

40154692-8-610-omnitouch-final2.jpg
8 of 9 Microsoft Research/CMU

Omnitouch

Researchers say the wearable shoulder-mounted prototype could be reduced to a matchbox-sized device that could be worn on a watch or a pendant.

40154692-9-610-omnitouch-fingers.jpg
9 of 9 Microsoft Research/CMU

Omnitouch

A shot showing how the system recognises and traces fingers.

Related Galleries

Holiday wallpaper for your phone: Christmas, Hanukkah, New Year's, and winter scenes
Holiday lights in Central Park background

Related Galleries

Holiday wallpaper for your phone: Christmas, Hanukkah, New Year's, and winter scenes

21 Photos
Winter backgrounds for your next virtual meeting
Wooden lodge in pine forest with heavy snow reflection on Lake O'hara at Yoho national park

Related Galleries

Winter backgrounds for your next virtual meeting

21 Photos
Holiday backgrounds for Zoom: Christmas cheer, New Year's Eve, Hanukkah and winter scenes
3D Rendering Christmas interior

Related Galleries

Holiday backgrounds for Zoom: Christmas cheer, New Year's Eve, Hanukkah and winter scenes

21 Photos
Hyundai Ioniq 5 and Kia EV6: Electric vehicle extravaganza
img-8825

Related Galleries

Hyundai Ioniq 5 and Kia EV6: Electric vehicle extravaganza

26 Photos
A weekend with Google's Chrome OS Flex
img-9792-2

Related Galleries

A weekend with Google's Chrome OS Flex

22 Photos
Cybersecurity flaws, customer experiences, smartphone losses, and more: ZDNet's research roundup
shutterstock-1024665187.jpg

Related Galleries

Cybersecurity flaws, customer experiences, smartphone losses, and more: ZDNet's research roundup

8 Photos
Inside a fake $20 '16TB external M.2 SSD'
Full of promises!

Related Galleries

Inside a fake $20 '16TB external M.2 SSD'

8 Photos