Real-time mosaicking for infrared videos from an oblique sweeping camera

• 作者: Jiazhen LU Fangde SUN Jing DONG Songlai HAN Ang SU
• 来源期刊: 中国航空学报（英文版）
• 年，卷（期）: 2021,（1）
• 页码范围: 309-319
• 页数: 11页
• 语种: 英文

摘要

Image mosaicking is widely used in Geographic Information Systems (GISs) for large-scale ground surface analysis. However, most existing mosaicking methods can only be used in off-line processing due to the enormous amounts of computation. In this paper, we propose a novel and practical algorithm for real-time infrared video mosaicking. To achieve this, a novel fast template matching algorithm based on Sum of Cosine Differences (SCD) is proposed to coarsely match the sequential images. The high speed of the proposed template matching algorithm is obtained by com-puting correlation with Fast Fourier Transform (FFT). We also propose a novel fast Least Squares Matching (LSM) algorithm for inter-frame fine registration, which can significantly reduce the com-putation without degrading the matching accuracy. In addition, the proposed fast LSM can effec-tively adapt for noise degradation and geometric distortion. Based on the proposed fast template matching algorithm and fine registration algorithm, we develop a practical real-time mosaicking approach which can produce seamless mosaic image highly efficiently. Experiments on synthetic and real-world datasets demonstrate that the proposed algorithm is not just computationally effi-cient but also robust against various noise distortions.