| | |

2004-2005 Success Stories

"Nouse": Scientific Impact with Huge Social Potential

In Brief

The major impact of the NRC-IIT Computational Video Research Group’s work in the development of Nouse is scientific impact – providing leadership in perceptual vision technologies. The Nouse, short for "nose as mouse" has captured broad public interest from regions as far off as China, Russia and South Africa. The BBC, CNN, the Discovery Channel, Maclean’s Magazine, Reuters, and a host of other international media outlets vigorously chased the story. Nouse has both a novel and functional side, from video game entertainment to hands-free devices for people with disabilities. The potential commercialization prospects for Nouse technology are enormous, as illustrated by the wave of media interest.

“Dr. Gorodnichy’s work on visual recognition of body motion goes back to his days working on upgrading the robotic lifting arm used in the space shuttle. He was one of many scientists at the research council who had worked on that project, which was Canadian designed and built.”
Ian Austen, the New York Times.

“The Nouse is still in the prototype phase but Dmitry hopes it will be available for everyone to use…whether it be as an alternative to the keyboard or for gaming…Just like its predecessor the mouse back in the 1960s, the Nouse was created to make computer operations easier for everyone.”
Shannon Bentley, Discovery Channel.

Nouse – it can read the expression on your face!

Nouse technology was developed more than three years ago by Dr. Dmitry Gorodnichy, Research Officer for the NRC-IIT Computational Video Research Group in Ottawa. In late 2004, Nouse technology became the focus of a huge wave of global media attention. Initiating the media charge was Britain's popular science magazine, the New Scientist, which published an article on Nouse after release of an international journal publication focusing on the technology.

The "Nouse", short for "nose as mouse" captured broad public interest from regions as far off as China, Russia and South Africa. The BBC, CNN, the Discovery Channel, Maclean’s Magazine, Reuters, and a host of other international media outlets vigorously chased the story.

The technology prototype is recognized as the first to use the nose as a principle feature for facial tracking, a process that involves hooking up a webcam to a computer equipped with tracking software. The computer registers an image of your nose and then maps it onto the on-screen cursor, which you control with the movement of your nose. The nose's convex shape enables the computer to track movements with dramatically improved precision over traditional methods. Even if you turn your head to either side, the nose will always be within view of the camera, unlike the eyebrows or the mouth, which were formerly used for facial tracking.

When asked about all the media attention surrounding Nouse and related perceptual vision technologies, Dr. Gorodnichy of NRC-IIT's Computational Video Group said: "People seem to recognize the importance of vision and they are eager for the creation of computers that can see. Although computer vision has existed for some time, it is not within the average person's reach." Dr. Gorodnichy further explained, "Now, with the increased precision and robustness of Nouse, as well as the inexpensive cost of web cameras and mainstream use of such technologies, people want to take advantage of the technology. Nouse, along with tools such as Blink Detection and Facial Memorization and Recognition, offer exciting, new vision-based and hands-free interaction with computers that respond to their needs."

While the original name and the novelty of the invention certainly helped captivate readers' attention, it is the potential applications for the tool that sparked response. Curious readers flocked to the Nouse website to play a round of NousePong or Bubble Frenzy, two video games using perceptual vision techniques. Yet beyond the fun, Nouse and its perceptual vision technology offshoots, such as Blink Detection and Facial Memorization and Recognition, can also be applied to more practical areas, including security, biometrics, and immersive and collaborative environments, as well as in the development of hands-free devices for those with physical disabilities, one of its more obvious applications.

Building on Nouse, Blink Detection and Facial Memorization and Recognition are two features that have been incorporated into Nouse technology. To activate Nouse, all you have to do is simply blink twice. Depending upon the programming of the technology, eye blinks could be used to activate any number of commands. As for the addition of Facial Recognition, your computer will soon be able to recognize you and greet you by name. These new tools are focused not on replacing current technologies, but on responding to a need to provide end users with alternatives for remote interaction with computers. Although not yet “on the shelf,” Nouse technology holds great potential.

Contact

Dr. Dmitry Gorodnichy
Research Officer
Computational Video
NRC Institute for Information Technology
1200 Montreal Road
Building M-50, Room C-330
Ottawa, ON K1A 0R6
Telephone: +1 (613) 998-5298
Fax: +1 (613) 952-0215
E-mail: Dmitry Gorodnichy