PhotoSketch: better than sliced bread, Photoshop

Summary:This is quite possibly the coolest thing I've ever seen a computer do.What if you could draw some stick figures on a screen and somehow magically create a beautiful image montage?

This is quite possibly the coolest thing I've ever seen a computer do.

What if you could draw some stick figures on a screen and somehow magically create a beautiful image montage?

Well, it's possible.

A group of students in China have created PhotoSketch, a project that does exactly what I just described: it takes a rough, hand-drawn sketch, scours the web for photos that match, and runs them through an algorithm, stitching it all together. Watch this video presentation, you will not regret it:

Their abstract:

We present a system that composes a realistic picture from a simple freehand sketch annotated with text labels. The composed picture is generated by seamlessly stitching several photographs in agreement with the sketch and text labels; these are found by searching the Internet. Although online image search generates many inappropriate results, our system is able to automatically select suitable photographs to generate a high quality composition, using a filtering scheme to exclude undesirable images.

We also provide a novel image blending algorithm to allow seamless image composition. Each blending result is given a numeric score, allowing us to find an optimal combination of discovered images. Experimental results show the method is very successful; we also evaluate our system using the results from two user studies.

Here is a link to the source code for the project if you want to tinker with it.

Mind-blowing, right?

Topics: China

About

Andrew Mager is a hacker advocate at Spotify in New York City. Before moving to NY, Andrew worked at SimpleGeo & Ning in San Francisco. Previously, he was an associate technical producer at CBS Interactive. Andrew studied print & electronic journalism at Virginia Tech, where he created a student-run online news publication called Planet B... Full Bio

zdnet_core.socialButton.googleLabel Contact Disclosure

Kick off your day with ZDNet's daily email newsletter. It's the freshest tech news and opinion, served hot. Get it.

Related Stories

The best of ZDNet, delivered

You have been successfully signed up. To sign up for more newsletters or to manage your account, visit the Newsletter Subscription Center.
Subscription failed.