Omnidirectional video stabilisation on a virtual camera using sensor fusion

This paper presents a method for robustly stabilising omnidirectional video given the presence of significantrotations and translations by creating a virtual camera and using a combination of sensor fusion and scene tracking. Real time rotational movements of the camera are measured by an Inertial M...

Full description

Bibliographic Details
Main Authors: Albrecht, Thomas, Tan, Tele, West, Geoffrey, Ly, T.
Other Authors: C. Wen
Format: Conference Paper
Published: IEEE Computer Society 2010
Subjects:
Online Access:http://hdl.handle.net/20.500.11937/25230
Description
Summary:This paper presents a method for robustly stabilising omnidirectional video given the presence of significantrotations and translations by creating a virtual camera and using a combination of sensor fusion and scene tracking. Real time rotational movements of the camera are measured by an Inertial Measurement Unit (IMU), which provides an initial estimate of the ego-motion of the camera platform. Image registration is then used to refine these estimates. The calculated ego-motion is then used to adjust an extract of the omnidirectional video, forming a virtual camera that is focused on the scene. Experiments show the technique is effective under challenging ego-motions and overcomes deficiencies that are associated with unimodal approaches making it robust and suitable to be used in many surveillance applications.