| | | |

Computational Video

Real-Time Video-Based Augmented Reality

Image representing the Real-Time Video-Based Augmented Reality project - Click for full view

In augmented reality (AR), users wear specialized glasses or look through a modified viewing screen to see the real world, as well as augmentations in the virtual world.

AR differs from virtual reality because users can interact with the physical world while still seeing the virtual augmentations. The most commonly used form of AR is the "Heads Up Display" in some aircraft that allows pilots to see the ground below them in addition to superimposed virtual targets.

A basic challenge in AR is to track a user's viewpoint in real-time, which is normally done using a video camera. The most successful method of tracking is to use a predefined 2D pattern, relative to which virtual objects are drawn.

The goal of the Real-Time Video-Based Augmented Reality project is to improve the tracking technology of such patterns. Already research results have led to some improvements in:

the ability to deal with occlusions in patterns
the ability to track patterns using two cameras
the ability to interact with virtual augmentations in addition to 2D patterns
the ability to use lines rather than corners for pattern tracking
the ability to decide which set of patterns is most useful

Ultimately, researchers hope to track the camera path in real-time in an unstructured environment, which can be used in both augmented reality and model building applications.

Research Contact

Dr. Gerhard Roth
Group Leader
Computational Video
NRC Institute for Information Technology
1200 Montreal Road
Building M-50, Room C-327
Ottawa, ON K1A 0R6
Telephone: +1 (613) 993-1219
Fax: +1 (613) 952-0215
E-mail: Gerhard.Roth@nrc-cnrc.gc.ca

Business Contact

Dr. George Forester
Business Development Officer
Business Development Office, NCR
NRC Institute for Information Technology
1200 Montreal Road
Building M-50, Room 203
Ottawa, ON K1A 0R6
Telephone: +1 (613) 993-3478
Fax: +1 (613) 952-0074
E-mail: George.Forester@nrc-cnrc.gc.ca