Search
  • Videos
  • Windows 10
  • 5G
  • CES
  • Best VPNs
  • Cloud
  • Security
  • more
    • AI
    • TR Premium
    • Working from Home
    • Innovation
    • Best Web Hosting
    • ZDNet Recommends
    • Tonya Hall Show
    • Executive Guides
    • ZDNet Academy
    • See All Topics
    • White Papers
    • Downloads
    • Reviews
    • Galleries
    • Videos
    • TechRepublic Forums
  • Newsletters
  • All Writers
    • Preferences
    • Community
    • Newsletters
    • Log Out
  • Menu
    • Videos
    • Windows 10
    • 5G
    • CES
    • Best VPNs
    • Cloud
    • Security
    • AI
    • TR Premium
    • Working from Home
    • Innovation
    • Best Web Hosting
    • ZDNet Recommends
    • Tonya Hall Show
    • Executive Guides
    • ZDNet Academy
    • See All Topics
    • White Papers
    • Downloads
    • Reviews
    • Galleries
    • Videos
    • TechRepublic Forums
      • Preferences
      • Community
      • Newsletters
      • Log Out
  • us
    • Asia
    • Australia
    • Europe
    • India
    • United Kingdom
    • United States
    • ZDNet around the globe:
    • ZDNet France
    • ZDNet Germany
    • ZDNet Korea
    • ZDNet Japan

Photos: Microsoft Kinect pushes natural UI frontier

1 of 9 NEXT PREV
  • 40154148-1-610-microsoft-kinect-research-1.jpg

    Computer vision set to change how we interact with all our machines, says Microsoft...

    Microsoft has been showcasing how its Kinect computer-vision technology is pushing beyond the boundaries of gaming. Computer vision refers to a research field exploring how computers can extract data from images. Just as our eyes and brain sense and inform us about our immediate environment, a computer equipped with a camera and computer-vision software can identify objects or sense movements in its vicinity.

    During a tech demo day at its Seattle offices last week, Microsoft demonstrated how computer vision and Kinect-style natural user interfaces (NUIs) could change how people interact with machines and screens in future. In February, the company announced it will be launching an SDK for Kinect to enable third-party developers to create software for a Kinect motion sensor plugged directly into a Windows PC - potentially bringing NUIs to a monitor near you soon.

    "GUI plus NUI is the way people will interact with computers in future," said Craig Mundie, Microsoft's chief research and strategy officer, in a statement.

    Pictured above is one of Mircosoft's NUI research projects - called Avatar Kinect - which enables Kinect users' avatars to mimic the head movements, speech and facial expressions of their human owners. Participants can also hang out with other Avatar Kinect users in virtual environments and shoot animated videos to share online, said Microsoft.

    Published: March 1, 2011 -- 12:42 GMT (04:42 PST)

    Photo by: Microsoft

    Caption by: Natasha Lomas

  • 40154148-2-610-microsoft-kinect-research-2.jpg

    In the second generation of Microsoft's Surface touchscreen technology - Surface 2.0 - the table itself is one large camera, so it can recognise objects such as this paint brush, and also identify the direction of users' hands and finger orientation.

    Published: March 1, 2011 -- 12:42 GMT (04:42 PST)

    Photo by: Microsoft

    Caption by: Natasha Lomas

  • 40154148-3-610-microsoft-kinect-research-3.jpg

    Here, a Microsoft researcher uses a handheld digital camera to take a series of 2D images of a statue.

    Published: March 1, 2011 -- 12:42 GMT (04:42 PST)

    Photo by: Microsoft

    Caption by: Natasha Lomas

  • 40154148-4-610-microsoft-kinect-research-4.jpg

    The images of the statue are then automatically converted and rendered into a photo-realistic 3D model of the statue, which can be manipulated on screen. The system does not require a high-end camera to generate the 3D model, even working with a mobile cameraphone.

    Published: March 1, 2011 -- 12:42 GMT (04:42 PST)

    Photo by: Microsoft

    Caption by: Natasha Lomas

  • 40154148-5-610-microsoft-kinect-research-6.jpg

    Here, in a project known as Mirage Blocks, a stereoscopic projector and the Kinect camera are used to render real objects digitally in a 3D space. The virtual objects could then be used for remote collaboration on projects.

    Published: March 1, 2011 -- 12:42 GMT (04:42 PST)

    Photo by: Microsoft

    Caption by: Natasha Lomas

  • 40154148-6-610-microsoft-kinect-research-5.jpg

    This photo-realistic digital talking head is the fruit of another Microsoft research project. The head can be animated in real time so it appears to speak the text that is being typed into the dedicated text box on the left. Microsoft envisages using the technique to create more believable avatars in future.

    Published: March 1, 2011 -- 12:42 GMT (04:42 PST)

    Photo by: Microsoft

    Caption by: Natasha Lomas

  • 40154148-7-610-microsoft-kinect-research-7.jpg

    This demo from Microsoft's Applied Sciences Group shows how touchscreens could evolve. Instead of touching a surface, the user makes gestures above a retro-reflective screen which has a camera and a projector pointing down at it.

    Computer-vision algorithms are then used to interpret individual gestures - such as the closed-finger loop pictured above - enabling the user to write, paint or control navigation on top of the screen.

    Published: March 1, 2011 -- 12:42 GMT (04:42 PST)

    Photo by: Microsoft

    Caption by: Natasha Lomas

  • 40154148-8-610-microsoft-kinect-research-8.jpg

    Microsoft envisages various NUI technologies being used in tandem in future. Here, Microsoft's Mundie shows a conceptual demo of various work and social NUI technologies organised into spherical hubs to illustrate how the various techs could be displayed and accessed together.

    Published: March 1, 2011 -- 12:42 GMT (04:42 PST)

    Photo by: Microsoft

    Caption by: Natasha Lomas

  • 40154148-9-610-microsoft-kinect-research-9.jpg

    Microsoft expects mobile phones to be used as the remote control to organise the various work and social hubs, as shown above.

    At the Mobile World Congress (MWC) trade show earlier this month, Microsoft CEO Steve Ballmer showed a video of a smartphone running its Windows Phone 7 OS being used in conjunction with the Kinect gaming peripheral - so that multiple players can participate in the same game across different devices.

    "2011 is shaping up to be a very fast-paced year," said Ballmer at MWC. "It should be a great year for the development of intelligent mobile devices and the value that they add to society."

    Published: March 1, 2011 -- 12:42 GMT (04:42 PST)

    Photo by: Microsoft

    Caption by: Natasha Lomas

1 of 9 NEXT PREV
Natasha Lomas

By Natasha Lomas | March 1, 2011 -- 12:42 GMT (04:42 PST) | Topic: Hardware

  • 40154148-1-610-microsoft-kinect-research-1.jpg
  • 40154148-2-610-microsoft-kinect-research-2.jpg
  • 40154148-3-610-microsoft-kinect-research-3.jpg
  • 40154148-4-610-microsoft-kinect-research-4.jpg
  • 40154148-5-610-microsoft-kinect-research-6.jpg
  • 40154148-6-610-microsoft-kinect-research-5.jpg
  • 40154148-7-610-microsoft-kinect-research-7.jpg
  • 40154148-8-610-microsoft-kinect-research-8.jpg
  • 40154148-9-610-microsoft-kinect-research-9.jpg

Computer vision set to change how we interact with all our machines, says Microsoft...

Read More Read Less

Computer vision set to change how we interact with all our machines, says Microsoft...

Microsoft has been showcasing how its Kinect computer-vision technology is pushing beyond the boundaries of gaming. Computer vision refers to a research field exploring how computers can extract data from images. Just as our eyes and brain sense and inform us about our immediate environment, a computer equipped with a camera and computer-vision software can identify objects or sense movements in its vicinity.

During a tech demo day at its Seattle offices last week, Microsoft demonstrated how computer vision and Kinect-style natural user interfaces (NUIs) could change how people interact with machines and screens in future. In February, the company announced it will be launching an SDK for Kinect to enable third-party developers to create software for a Kinect motion sensor plugged directly into a Windows PC - potentially bringing NUIs to a monitor near you soon.

"GUI plus NUI is the way people will interact with computers in future," said Craig Mundie, Microsoft's chief research and strategy officer, in a statement.

Pictured above is one of Mircosoft's NUI research projects - called Avatar Kinect - which enables Kinect users' avatars to mimic the head movements, speech and facial expressions of their human owners. Participants can also hang out with other Avatar Kinect users in virtual environments and shoot animated videos to share online, said Microsoft.

Published: March 1, 2011 -- 12:42 GMT (04:42 PST)

Caption by: Natasha Lomas

1 of 9 NEXT PREV

Related Topics:

Hardware PCs Servers Storage Networking Data Centers
Natasha Lomas

By Natasha Lomas | March 1, 2011 -- 12:42 GMT (04:42 PST) | Topic: Hardware

Show Comments
LOG IN TO COMMENT
  • My Profile
  • Log Out
| Community Guidelines

Join Discussion

Add Your Comment
Add Your Comment

Related Galleries

  • 1 of 3
  • Anker PowerLine III Flow USB-to-Lightning cables

    Manufactured from silica gel with a graphene lining, the cable feels soft to the touch, and actually sort of flows through the hand. This isn't just about aesthetics, but it allows ...

  • Netgear LM1200 4G LTE modem

    The Netgear LM1200 4G LTE modem offers a reliable LKTE alternative for fixed-line internet.

  • Netgear AXE11000 Nighthawk Tri-Band Wi-Fi 6E router

    The Netgear AXE11000 offers combined speeds up to 10.8Gbps, is built around a powerful 1.8GHz quad-core processor, and can deliver fast and reliable connections for up to 60 devices ...

  • OWC USB-C Travel Dock E

    A single mini dock that allows you to connect, charge, display, network, and import on-the-go, all through a single cable and a single USB-C port.

  • OWC Thunderbolt Dock

    Turn a single Thunderbolt port into four Thunderbolt ports, four USB ports, as well as a port for your SD Card, Gigabit Ethernet, and a combo audio in/out. ...

  • Has your iPhone or iPad stopped charging? Check this first!

    Has your iPhone or iPad suddenly and unexpectedly stopped charging? Or has charging become slow, or is charging intermittent even though the cable is plugged in and the charger is ...

  • Aukey's CC-A6 dual-port USB-C/USB-A fast car charger

    The CC-A6 is tiny. So tiny that's it's hard to believe that there's all the circuitry inside it to power two USB ports and to be able to deliver 30W.

ZDNet
Connect with us

© 2021 ZDNET, A RED VENTURES COMPANY. ALL RIGHTS RESERVED. Privacy Policy | Cookie Settings | Advertise | Terms of Use

  • Topics
  • Galleries
  • Videos
  • Sponsored Narratives
  • Do Not Sell My Information
  • About ZDNet
  • Meet The Team
  • All Authors
  • RSS Feeds
  • Site Map
  • Reprint Policy
  • Manage | Log Out
  • Join | Log In
  • Membership
  • Newsletters
  • Site Assistance
  • ZDNet Academy
  • TechRepublic Forums