PhotoSketch: better than sliced bread, Photoshop

PhotoSketch: better than sliced bread, Photoshop

Summary: This is quite possibly the coolest thing I've ever seen a computer do.What if you could draw some stick figures on a screen and somehow magically create a beautiful image montage?

SHARE:
TOPICS: China
28

This is quite possibly the coolest thing I've ever seen a computer do.

What if you could draw some stick figures on a screen and somehow magically create a beautiful image montage?

Well, it's possible.

A group of students in China have created PhotoSketch, a project that does exactly what I just described: it takes a rough, hand-drawn sketch, scours the web for photos that match, and runs them through an algorithm, stitching it all together. Watch this video presentation, you will not regret it:

Their abstract:

We present a system that composes a realistic picture from a simple freehand sketch annotated with text labels. The composed picture is generated by seamlessly stitching several photographs in agreement with the sketch and text labels; these are found by searching the Internet. Although online image search generates many inappropriate results, our system is able to automatically select suitable photographs to generate a high quality composition, using a filtering scheme to exclude undesirable images.

We also provide a novel image blending algorithm to allow seamless image composition. Each blending result is given a numeric score, allowing us to find an optimal combination of discovered images. Experimental results show the method is very successful; we also evaluate our system using the results from two user studies.

Here is a link to the source code for the project if you want to tinker with it.

Mind-blowing, right?

Topic: China

Kick off your day with ZDNet's daily email newsletter. It's the freshest tech news and opinion, served hot. Get it.

Talkback

28 comments
Log in or register to join the discussion
  • Turn it 3D, and we have a holodeck!

    Turn it into something 3D, add voice commands -
    and you have something quite similar to how Star
    Trek usually portrays its holodeck!
    CobraA1
  • RE: PhotoSketch: better than sliced bread, Photoshop

    Your "source code" link points to a file called Binary.zip that contains... just the binary, no source.

    After setting the paths in the .ini files as per the readme and file comments, they still just fail with "The system cannot execute the specified program."
    hrmlss
    • RE: PhotoSketch: better than sliced bread, Photoshop

      To facilitate seems consequently by the side of alleviate a minute ago ahead of <a href="http://flvto.com/">youtube converter</a> if you gain <a href="http://flvto.com/">youtube to mp3 converter</a> bearing in mind to <a href="http://flvto.com/">youtube mp3 converter</a>
      youtube to mp3 converter
  • RE: PhotoSketch: better than sliced bread, Photoshop

    Yea, this is sketchy ... I see a google project of this name released in 07, they didn't trademark it? And with the source being binaries... Sure, 'some students in china' did make me suspicious, maybe, just like 'some kids from the Ukraine' or 'a group of russian researchers' would.
    h310ise
  • RE: PhotoSketch: better than sliced bread, Photoshop

    Funnly enough, on my Podcast Ben & I are bangin on about
    this tech, it's on release next week:

    http://gogomedia.tv/blog
    http://linkr.tv/r/VGC8 (vote for us @ 09 podcasting award)

    Naz.
    nazimjamil
  • RE: PhotoSketch: better than Phishing with sliced bread?

    I truly hope it's real, as it looks wonderful.

    But, it is soooo good, that I am suspicious!

    SIGGRAPH Asia 2009 hasn't happened yet, it is in December.
    Lack of source? Phishy!

    As an experiment, I google images with their search terms:
    seagull, beach wedding kiss, sunset beach sailboat
    and got many of the images on their starting point
    Then I'd need a couple of dozen photoshop images, and a nice voice
    over.

    I checked at google, and it's the 20th most popular search for the last
    hour. That's going to be a lot of voluntary installs.

    Has anyone got this working? I downloaded it, and there is no source.
    The largest program is only 44Kbytes. The total size is only
    172Kbytes. That seems very small for a piece of breakthrough code.

    Please don't misunderstand, I'd *LOVE* this to be real. But ...
    GB-UK
  • Copyright infringement

    So...this program scours the web, steals content from pictures and then creates fake looking composites?

    I can't wait for the lawsuit when this program steals from a famous photograph and some media company uses it in a campaign or something.
    alexh1111
    • Just what I was thinking. Or pastes some

      celebrity head onto a pornographic picture.
      clfitz
    • alas, agreed . . . (nt)

      nt = no text
      CobraA1
    • Creative Commons Search

      http://search.creativecommons.org/ if you are that fraid...
      ciantic
    • not an issue

      this is just experimental code. It is the
      responsibility of the publisher to ensure that
      the material they use is not in violation of
      copyright. If you run the code on your own
      computer with your own pictures and/or legally
      owned clipart it will do the same function.
      Also as previously mentioned creative commons
      works are the obvious source for online
      material.

      On another note, I am fairly certain that you
      can use a small portion of a copywrited work
      without being in violation as long as the work
      is referenced. (i.e. the first paragraph of a
      book, a clip from a song, etc...) I don't know,
      with images, if you can use a small enough
      portion of an image to not be in violation, but
      I have heard that you can use a small enough
      thumbnail to not be in violation. This may be
      an option for this software there.
      shadfurman
  • RE: PhotoSketch: better than sliced bread, Photoshop

    I wonder how long it will be before Adobe either (a) takes a hit out on the students or (b) attempts to purchase students and/or software and integrating them in to the Empire CS.

    This is, without a doubt, a game-changer.
    khorsia
  • PhotoSketch and Stock Image Sites

    This would be a great tool if they could make it easily integrable into stock image sites like http://www.ClipartOf.com/.

    It would need to record the id numbers of each image used in the final image design so that each artist can get paid or credited.
    clipartguy
  • RE: PhotoSketch: better than sliced bread, Photoshop

    Its a gimmick. It's not a professional application. Photoshop is a application with strict creative human control. Your headline is sensationalist.
    nickpotgieter
    • du... it's a headline... every headline ever is sensationalist(nt)

      /
      shadfurman
  • RE: PhotoSketch: better than sliced bread, Photoshop

    Yeah right.the Chinese are too stupid to restrict images to none copyright materiel?

    you could, of course, try to use it, and then make an INFORMED comment?............. nope guessed so.
    firemouth
  • What a useless piece of crap...But still good for the avarage freetard....n

    nt
    transposeIT
    • Check your spelling, Freetard

      Avarage is spelled average.
      jpr75_z
  • Impressive Programming

    I wish my business apps had this kind of intelligence. It would make my job a whole lot easier.
    jpr75_z
  • RE: PhotoSketch: better than sliced bread, Photoshop

    Really? This is so clearly a fake. How about some objective posting. The detail in the matte cut outs is completely unbelievable.

    Look for it on Snopes in a few days.
    ritchotte