'Block reasoning' technique improves computer vision

'Block reasoning' technique improves computer vision

Summary: Computer scientists at Carnegie Mellon University have devised a method that enables computers to better understand an image by making assumptions about the physical constraints of the scene.

TOPICS: CXO, Hardware

Computer scientists at Carnegie Mellon University have devised a method that enables computers to better understand an image by making assumptions about the physical constraints of the scene.

Credit: Carnegie Mellon University

The researchers say that like a child using toy building blocks to assemble something that looks like a building, a computer could analyze an outdoor scene by using virtual blocks to build a three-dimensional  approximation of the image based on parameters of volume and mass.

“When people look at a photo, they understand that the scene is geometrically constrained,” said Abhinav Gupta of CMU’s Robotics Institute. “We know that buildings aren’t infinitely thin, that most towers do not lean, and that heavy objects require support. It might not be possible to know the three-dimensional size and shape of all the objects in the photo, but we can narrow the possibilities.”

According to a university release, the new method works by first breaking down the image into various segments that correspond to objects in the image. Once the ground and sky are identified, other segments are assigned potential geometric shapes. The shapes are categorized as light or heavy, depending on appearance. So a surface that appears to be a brick wall, for instance, would be classified as heavy. The computer then tries to reconstruct the image using the virtual blocks. If a heavy block appears unsupported, the computer must substitute an appropriately shaped block, or make assumptions that the original block was obscured in the original image.

Understanding outdoor scenes remains one of the great challenges of computer vision and artificial intelligence. One approach has been to identify features of a scene, such as buildings, roads and cars, but this provides no understanding of the geometry of the scene, such as the location of walkable surfaces. Another approach, pioneered in part by the same Carnegie team, has been to map the planar surfaces of an image to create a rough 3-D depiction of an image, similar to a pop-up book. But that approach can lead to depictions that are highly unlikely and sometimes physically impossible.

The "qualitative volumetric" approach is so new according to Gupta, that no established datasets or evaluation methodologies exist for it. "In estimating the layout of surfaces, other than sky and ground, the method is better than 70 percent accurate, and its performance is almost as good when comparing its segmentation to ground truth."

Gupta presented the research, which he conducted with Efros and Robotics Professor Martial Hebert, at the European Conference on Computer Vision, Sept. 5-11 in Crete, Greece.

Related reading:

Researchers rethink approaches to computer vision

Topics: CXO, Hardware

Kick off your day with ZDNet's daily email newsletter. It's the freshest tech news and opinion, served hot. Get it.


Log in or register to join the discussion
  • RE: 'Block reasoning' technique improves computer vision

    I see that you are interested about Computer vision.
    Doing my research I find one amazing free to download book about it.
    This book presents research trends on computer vision, especially on application of robotics, and on advanced approaches for computer vision (such as omnidirectional vision).
    The contents of this book allow the reader to know more technical aspects and applications of computer vision.
    The intended audience is anyone who wishes to become familiar with the latest research work on computer vision, especially its applications on robots.
    This book features representative work on the computer vision, and it puts more focus on robotics vision and omnidirectional vision.
    This is the link where you can find it: http://sciyo.com/books/show/title/computer_vision
    • RE: 'Block reasoning' technique improves computer vision

      <a href="http://www.facebookvideoindir.us">facebook video indir</a>
      <a href="http://www.kuzeyguneydizisi.us">kuzey guney</a>
      <a href="http://www.laptoptamiri.biz">laptop tamiri</a>
      <a href="http://ankaraotokiralamak.blogcu.com">oto kiralama ankara</a>
      <a href="http://ankaraotokiralamak.blogcu.com">ankara oto kiralama</a>
      <a href="http://www.facebookvideonuindir.com">facebook video indir</a>
      <a href="http://www.kuzeyguneydizisi.us">kuzey guney dizisi</a>
  • RE: 'Block reasoning' technique improves computer vision

    I would like first <a href="http://www.NetKeyfim.net" title="Sohbet, Sohbet Odalari">Sohbet</a><a href="http://www.NetKeyfim.net" title="Sohbet, Sohbet Odalari">Sohbet Odalari</a> to congratulate our esteemed <a href="http://www.NetKeyfim.net" title="Sohbet, Mynet Sohbet">Mynet Sohbet</a>|<br><a href="http://www.seviyelichat.net" title="Sohbet Odalari, Chat">Sohbet Odalari</a>|<a href="http://www.islamifm.com" title="islami sohbet, islami chat">islami sohbet</a>|<br><a href="http://www.islamifm.com" title="islami chat, islami sohbet">islami chat</a>|<a href="http://www.islamifm.com" title="islami radyo">islami radyo</a>| managers andemployees have a<a href="http://www.sohbetodalarimiz.net" title="Sohbet Odalari, sohbet siteleri">Sohbet Odalari</a>|<br><a href="http://www.sohbetodalarimiz.net" title="Sohbet Siteleri, sohbet odalari">sohbet siteleri</a>|<a href="http://www.sosyetechat.net" title="chat, chat siteleri">chat</a>|<br><a href="http://www.sosyetechat.net" title="chat siteleri, chat">chat siteleri</a>| really great working with your portal will<a href="http://www.chatvesohbet.net" title="Chat, Chat sohbet">Chat</a>|<a href="http://www.chatvesohbet.net" title="Chat Sohbet, Chat">Chat Sohbet</a>|<a href="http://www.chatvesohbet.net" title="Chat, Chat Siteleri">Chat Siteleri</a>|<br>made ??a great blog wor<a href="http://www.canakkalesohbet.com" title="canakkale sohbet, canakkale chat">canakkale sohbet</a>|<a href="http://www.canakkalesohbet.com" title="canakkale chat, canakkale sohbet">canakkale chat</a>| have a very ambitious,you would like to <a href="http://www.canakkalesohbet.com" title="Sohbet Odalari">Sohbet Odalari</a>|<a href="http://www.tryemektarifleri.com" title="yemek tarifleri, yemektarifleri">yemek tarifleri</a>|<a href="http://www.tryemektarifleri.com" title="yemektarifleri, resimli yemek tarifleri">yemektarifleri</a>|<a href="http://www.tryemektarifleri.com" title="yemektarifleri, oktay usta yemek tarifleri">oktay usta yemek tarifleri</a>|visit when I found every opportunity I have read your postsvery helpful and useful, <a href="http://www.tryemektarifleri.com" title="yemek tarifleri,resimli yemek tarifleri">resimli yemek tarifleri</a>|<a href="http://www.tryemektarifleri.com" title="yemek tarifleri, Pasta Tarifleri">Pasta Tarifleri</a>|<br><a href="http://www.tryemektarifleri.com" title="Pasta Tarifleri, Kurabiye Tarifleri">Kurabiye Tarifleri</a>|<br><a href="http://www.tryemektarifleri.com" title="Kolay Yemek Tarifleri">Kolay Yemek Tarifleri</a>|<br><a href="http://www.tryemektarifleri.com" title="tatli tarifleri">tatli tarifleri</a>| to read as much as I try to follow<a href="http://www.ankarachat.info" title="ankara sohbet, ankara sohbet odalari">ankara sohbet</a>|<a href="http://www.ankarachat.info" title="ankara sohbet, ankara chat">ankara chat</a> along with being active in my membership<br>news<a href="http://www.ankarachat.info" title="ankara sohbet odalari, ankara sohbet">ankara sohbet odalari</a>| about current<a href="http://www.netkeyfim.net" title="kamerali sohbet, kamerali sohbet odalari">kamerali sohbet</a>| issues in e-mail<a href="http://www.netkeyfim.net" title="kamerali sohbet, kamerali sohbet odalari">kamerali sohbet odalari</a> address I would like to thank you for letting us also<br>wish you success in your<a href="http://www.sosyetechat.net" title="ankara chat">ankara chat</a> studies <a href="http://www.sexkadini.net" title="sex izle, sex seyret">sex izle</a>|
    <a href="http://www.sexkadini.net" title="sex seyret, sex izle">sex seyret</a>|
    <a href="http://www.sexkadini.net" title="sex hikayeleri">sex hikayeleri</a>|
    will continue to be followers
  • RE: 'Block reasoning' technique improves computer vision

    gdfsgdfsNow, if the daughter had her contacts stored in her Mac's Address Book or on the MobileMe cloud, there's just no need for her to reenter those manually and I strongly doubt that the Genius employee would have suggested it. Thankfully the iPhone/iTunes sync features give this extra level of redundancy, but you have those sync features turned on, and you have plug your phone into your computer once in a while.
    <a href="http://www.mynetsohbet.us">mynet sohbet</a><a href="http://www.mynetsohbet.us">mynet</a><a href="http://www.ciceksohbet.com">sohbet</a><a href="http://www.ciceksohbet.com">Mynet Sohbet</a><a href="http://www.ciceksohbet.net">sohbet siteleri</a><a href="http://www.ciceksohbet.net">sohbet odalari</a><a href="http://www.ciceksohbet.net">yonja</a><a href="http://www.ciceksohbet.net/forum">forum siteleri</a><a href="http://www.ciceksohbet.net/ankara">ankara sohbet</a><a href="http://www.ciceksohbet.net/ankara">ankara chat</a><a href="http://www.ciceksohbet.net/almanya">almanya sohbet</a><a href="http://www.ciceksohbet.net/diziizle">dizi izle</a><a href="http://www.ciceksohbet.net/istanbul">istanbul sohbet</a><a href="http://mircindir.ciceksohbet.net">mirc indir</a><a href="http://www.lidermirc.net">mirc indir</a><a href="http://www.vaysohbet.com">sohbet</a><a href="http://www.delikanlimca.com">mynet sohbet</a><a href="http://www.delikanlimca.com">canli sohbet</a>Many iPhone users sync their phones a little less than they should.<a href="http://www.delikanlimca.com">sohbet siteleri</a>Hopefully Apple will add wireless syncing at some point in the future.<a href="http://www.vaysohbet.com">sohbet chat</a><a href="http://www.vaysohbet.com">netlog</a><a href="http://www.vaysohbet.com/mynet">mynet sohbet</a><a href="http://www.vaysohbet.com">netlog sohbet</a>Hopefully Apple will add wireless syncing at some point in the future.<a href="http://www.seviyelichat.net">chat</a><a href="http://www.seviyelichat.net">seviyeli chat</a><a href="http://www.seviyelichat.net">seviyeli sohbet</a><a href="http://www.vaysohbet.com/adana.htm">adana sohbet</a><a href="http://www.dinisohbett.net">dini sohbet</a><a href="http://www.cetsiteleri.net">cet siteleri</a><a href="http://www.cetsiteleri.net">cet</a><a href="http://www.kumsalim.net">bayan escort</a><a href="http://www.kumsalim.net">vip escort</a><a href="http://www.kumsalim.net">istanbul escort</a><a href="http://senolbalabantr.blogspot.com">senol balaban</a><a href="http://www.kumsalim.net">ankara escort</a><a href="http://www.kumsalim.net">izmir escort</a><a href="http://www.kumsalim.net">escort</a><a href="http://www.cetsiteleri.net/guncel/suatanlee-doktorlar-izle-spartacus-izle-dizi-izle-sacma-bana-gore.html">Suatanlee Doktorlar izle Spartacus izle Dizi izle Sa?ma Bana G?re</a><a href="http://www.ankarachat.info">ankara chat</a>Hopefully Apple will add wireless syncing at some point in the future.
  • RE: 'Block reasoning' technique improves computer vision