Many applications use multiple cameras to simultaneously capture imagery of a scene from different vantage points on a rigid, moving camera system over time. Multiple cameras often provide unique viewing angles but also additional levels of detail of a scene at different spatio-temporal resolutions. However, in order to benefit from this added information the sources must be temporally aligned. As a result of cost and physical limitations it is often impractical to synchronize these sources via an external clock device. Most methods attempt synchronization through the recovery of a constant scale factor and offset with respect to time. This limits the generality of such alignment solutions. We present an unsupervised method that utilizes a content-based clustering mechanism in order to temporally align multiple non-synchronized image sequences of different and varying spatio-temporal resolutions. We show that the use of temporal constraints and dynamic programming adds robustness to changes in capture rates, field of view, and resolution.
College and Department
Physical and Mathematical Sciences; Computer Science
BYU ScholarsArchive Citation
Ogden, Samuel R., "Automatic Content-Based Temporal Alignment of Image Sequences with Varying Spatio-Temporal Resolution" (2012). Theses and Dissertations. 3303.
multi-resolution temporal alignment, video alignment, hierarchical clustering, dynamic programming