Multiscale gigapixel video: A cross resolution image matching and warping approach

Xiaoyun Yuan, Lu Fang, Qionghai Dai, David J. Brady, Yebin Liu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

23 Scopus citations

Abstract

We present a multi-scale camera array to capture and synthesize gigapixel videos in an efficient way. Our acquisition setup contains a reference camera with a short-focus lens to get a large field-of-view video and a number of unstructured long-focus cameras to capture local-view details. Based on this new design, we propose an iterative feature matching and image warping method to independently warp each local-view video to the reference video. The key feature of the proposed algorithm is its robustness to and high accuracy for the huge resolution gap (more than 8x resolution gap between the reference and the local-view videos), camera parallaxes, complex scene appearances and color inconsistency among cameras. Experimental results show that the proposed multi-scale camera array and cross resolution video warping scheme is capable of generating seamless gigapixel video without the need of camera calibration and large overlapping area constraints between the local-view cameras.

Original languageEnglish (US)
Title of host publication2017 IEEE International Conference on Computational Photography, ICCP 2017 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781509057450
DOIs
StatePublished - Jun 16 2017
Externally publishedYes
Event2017 IEEE International Conference on Computational Photography, ICCP 2017 - Stanford, United States
Duration: May 12 2017May 14 2017

Publication series

Name2017 IEEE International Conference on Computational Photography, ICCP 2017 - Proceedings

Conference

Conference2017 IEEE International Conference on Computational Photography, ICCP 2017
Country/TerritoryUnited States
CityStanford
Period5/12/175/14/17

ASJC Scopus subject areas

  • Computational Theory and Mathematics
  • Computer Vision and Pattern Recognition
  • Instrumentation
  • Atomic and Molecular Physics, and Optics

Fingerprint

Dive into the research topics of 'Multiscale gigapixel video: A cross resolution image matching and warping approach'. Together they form a unique fingerprint.

Cite this