Wearable camera could store your life in images

HP's Bristol laboratory is researching a wearable, always-on camera that could capture terabytes of images, and then select the most memorable ones automatically

Hewlett-Packard is working on a new system of consumer photography that could see users "casually" capturing terabytes of images from their daily lives, to be stored in data centres and later retrieved for conventional printing. The "casual capture" project is one of the research projects underway at HP's labs in Bristol, England, the largest HP research facility outside of Palo Alto. Other research underway includes video streaming for mobile devices, e-books that attempt to capture the experience of reading a real book, a multi-channel XML publishing model and a virtualised data centre. "Casual capture" is HP's term for a way of taking snapshots that involves the minimum of effort on the part of the photographer. Ideally, the consumer could don an always-on, wearable camera, visit an event such as a party, and afterwards find that the camera had automatically selected and cropped the most memorable images. Researchers admit that this is probably an impossible goal, but are working on a more limited -- and possibly more realistic -- version of the technology. This continuously records images into a rolling buffer of a few seconds or minutes in duration; when something memorable happens, the user makes an indication of some kind, by saying a word or pressing a button. The camera technology then zooms in on that part of the buffer and, using complex pattern-recognition technology, selects what appear to be the best images, and appropriately adjusts and crops these images. "You say, 'Something has happened, I'd like to remember that,'" said Phil Cheatle of HP Labs' digital media department. "It allows you to take part in the event instead of hiding behind the technology. The challenge is selecting what's interesting automatically." The technique is designed to push the limits of how ordinary people take snapshots. While it is not designed to replace conventionally composed photography, it could vastly increase the number of photographs people take. Researchers said they expect casual capture to increase demand for low-cost storage, among other effects. Ideally, the user does not have to be aware that the camera is in operation. There is no viewfinder, the device instead being designed to capture roughly the user's field of vision, being mounted inside the bridge of a pair of glasses or elsewhere on the head. Capturing the images is less of a problem than automatically selecting and formatting them, however. One algorithm, for example, attempts to locate the centre of interest in a shot by identifying similar visual elements that are grouped together, then zooms in on that part of the picture. The imaging software can also recognise when a sequence of shots would best be presented as a video clip, and can transform a slow movement of the head into a panoramic image, by stitching a sequence of related shots together. The research hardware uses a small mounted camera attached by a cable to a bulky storage device, but researchers also demonstrated a camera mounted inside a pair of glasses. The hardware currently captures 5 frames per second into a buffer of 25 frames, though researchers said this could easily be increased. Building a better e-book
HP's digital imaging department is also working an e-book viewer that attempts to match as closely as possible the benefits of a physical book -- right down to the act of flipping the pages. The device, lightweight and slightly smaller than A4 in size, uses a TFT screen and uses ASCII text source data to create an image that looks like a photograph of an opened book. The screen is slightly higher-resolution than a computer monitor, at 100dpi, and uses modern anti-aliasing techniques to create a crisp image. However, project manager Anthony Sowden admitted that there is a trade-off between battery life and screen clarity: the screen needs a bright backlight to compete with natural daylight, but this saps battery power. "With the backlight on full, you can really feel the heat coming off the back," he said. The prototype e-book viewer has a minimum battery life of just three hours. One solution to this problem could be the use of bi-stable displays, which retain their state even when power is removed, requiring power only for turning the page. Sowden said that no such technology is ready for use yet, but if it could be employed, "battery life could be measured in months". The viewer does not use a touch-screen, as these are more reflective, but has touch-strips on the sides and bottom, which can be used to virtually flick or riffle pages. Users can replicate the experience of holding their place with one finger whilst riffling through pages with the other hand. "I have a great attachment to traditional books. But books will change, and I expect we will see multimedia and interactive books emerge," said Sowden. Hold the front page
HP researchers also showed off a way of formatting published pages in an XML language that allows the same document to contain information for Web, print, PDA and other versions -- something which could ultimately speed up so-called "multi-channel" publishing. "We are not capturing a document but a logical representation of it," said project manager Anthony Wiley. The Bristol lab is also working on HP's version of on-demand computing in the form of the Utility Data Centre (UDC). On-demand computing is designed to replace the current computing model, in which different parts of an organisation have their own specialised resources, with a general-purpose model that could reduce unused computing power. Under the on-demand model, a service automatically finds the resources it needs when it starts up. When the service is no longer needed, the resources are freed up to be used by other services. Services are configured and kept secure by a utility controller. Sun, IBM and other companies are working on their own on-demand computing projects.

See the Hardware News Section for the latest update on everything from MP3 players and PDAs to supercomputing. Let the editors know what you think in the Mailroom.