A UC San Diego computer scientist has turned his face into a remote control. One of his goals is to ‘use automated facial expression recognition to make robots more effective teachers.’ In fact, this project is ‘at the intersection of facial expression recognition research and automated tutoring systems.’ Changing the speed of the delivery of automated lessons to remote students could make a huge difference in learning. If the robotic teacher goes too fast for you, you need to tell it that it needs to slow down. And this can be done through smiling or frowning at a simple webcam installed on your laptop. But read more…
You can see above how a “UC San Diego computer science Ph.D. student can turn his face into a remote control that speeds and slows video playback.” (Credit: UC San Diego Jacobs School of Engineering, link to a slightly larger version) On the left part of this image, the largest rectangle shows how he controls the speed of the video. When he smiles, the black bars are at a high level and the video in front of him is displayed at high speed. When he frowns, the black bars are at a lower level and the video rate is slowed.
This research project has been led by Jacob Whitehill, a computer science Ph.D. student from UCSD Jacobs School of Engineering who works at the Machine Perception Laboratory (MPLab). If you want to see more visual explanations of Whitehill, here are two links to short videos. The first one lasts 55 seconds while the second one is 3 minutes and 40 seconds long.
But what exactly is the status of this research project? “In the pilot study, the facial movements people made when they perceived the lecture to be difficult varied widely from person to person. Most of the 8 test subjects, however, blinked less frequently during difficult parts of the lecture than during easier portions of the lecture, which is supported by findings in psychology. One of the next steps for this project is to determine what facial movements one person naturally makes when they are exposed to difficult or easy lecture material. From here, Whitehill could then train a user specific model that predicts when a lecture should be sped up or slowed down based on the spontaneous facial expressions a person makes, explained Whitehill.”
This research project will be presented on June 25 at the Intelligent Tutoring Systems 2008 conference (ITS 2008) held in Montreal, Canada, on June 23-27, 2008. The subject of the presentation is “Measuring the Perceived Di
