Implementation of image stabilization algorithm on a programmable logic integral circuit

Authors

  • Yuri N. Maslakov RSAU – MTAA named after K.A. Timiryazev
  • Denis V. Ursol Industrial Electronic Systems LLC

DOI:

https://doi.org/10.52575/2687-0932-2022-49-1-187-194

Keywords:

image stabilization, relative frame shift, programmable logic integrated circuit, Haar wavelet, Sobel operator

Abstract

This article discusses the implementation of an image stabilization algorithm based on the sum of absolute differences (SAD) between areas of adjacent frames. The relative and absolute displacement between frames is found for the minimum time interval between areas of interest. Information processing is carried out in parallel in 16 streams to minimize the delay time, and an alternative version of the algorithm is proposed using the Haar wavelet and the Sobel operator, which improves the main characteristics of the algorithm and reduces the effect of image noise and optical distortion. Increasing the number of free cycles of the algorithm allows you to increase the size of the substrate and the size of the target, which increases the stability of the algorithm. An assessment of the required resources for the possibility of running the developed algorithm on a programmable logic integrated circuit (FPGA) has been implemented on Cyclone V. The article shows the functional blocks and the main functions of the algorithm execution.

Downloads

Download data is not yet available.

Author Biographies

Yuri N. Maslakov, RSAU – MTAA named after K.A. Timiryazev

Junior Researcher, RSAU – MTAA named of  K.A. Timiryazev,
Moscow, Russia

Denis V. Ursol, Industrial Electronic Systems LLC

Candidate of Technical Sciences, Software Engineer, Industrial Electronic Systems LLC,
Belgorod, Russia

References

Солдатов С.А., Стрельников К.Н., Ватолин Д.С. 2006. Быстрое и надежное определение глобального движения в видеопоследовательностях. Труды конференции “Graphicon-2006”. C. 430–437.

Bakstein H., Pajdla T. 2002. Panoramic mosaicing with a 180 field of view lens Omnidirectional Vision. Proceedings. Third Workshop on. pp. 60–67.

Chernomorets D., Golikov V., Balabanova T., Prokhorenko E., Bolgova E., Chernomorets A. 2021. Correlation properties of sea surface images on video stream frames. International Journal of Nonlinear Analysis and Applications

Ertürk S. 2002. Real-time digital image stabilization using Kalman filters. Real-Time Imaging. 8: 317–328.

Guohe Z., Zejie K., Sufen W., Kai H., Feng L., Cheng Y. 2018. Hardware implementation for an improved full-pixel search algorithm based on normalized cross correlation method. Electronics, 7, 428.

Lin C., Hong C. 2009. Real-Time Digital Image Stabilization System Using Modified Proportional Integrated Controller. IEEE Transactions. Circuits and Systems for Video Technology. 19 (3): 427–431.

Litvin A., Konrad J. 2003. Probabilistic video stabilization using Kalman filtering and mosaicking. Proc. of SPIE Electronic Imaging. 2003. 5022: 663–674.

Liu Y., Zhang J., Gao J. 2013. Panoramic technique in the video monitoring system and Implementation. TELKOMNIKA Indonesian Journal of Electrical Engineering. Vol. 11, pp. 91–96.

Lowe D. 2004. Distinctive Image Features from Scale-Invariant Keypoints. International Journal of Computer Vision.

Pan Z., Ngo C. 2005. Selective Object Stabilization for Home Video Consumers. IEEE Transactions on Consumer Electronics. 51(4): 248–253.

Sharif Shah Newaj Bhuiyan, Othman O. Khalifa. 2018. Robust Automatic Multi-Camera Viewpoint Stabilization using Harris Laplace corner detection and Spanning Tree. 7th International Conference on Computer and Communication Engineering (ICCCE)

Thibault S., Artonne J. 2006. Panomorph lenses: a low-cost solution for panoramic surveillance. Defense and Security Symposium. International Society for Optics and Photonics.

Wang X., Wu K., Cheng Y. 2013. Research on Virtual 3D Station based on Images. Applied Mathematics & Information Sciences. 7(1L): 225–231.124.

Xu C., Bai Y. 2017. Implementation of Harris corner matching based on FPGA. 6th International Conference on Energy and Environmental Protection (ICEEP 2017), Advances in Engineering Research (AER), volume 143.

Yang J., Schonfeld D. 2009. Video Stabilization based on particle filter tracking of projected camera motion. IEEE Transection. Circuits and Systems for Video Technology. 19(7): 945–954.


Abstract views: 89

Share

Published

2022-03-30

How to Cite

Maslakov, Y. N., & Ursol, D. V. (2022). Implementation of image stabilization algorithm on a programmable logic integral circuit. Economics. Information Technologies, 49(1), 187-194. https://doi.org/10.52575/2687-0932-2022-49-1-187-194

Issue

Section

INFOCOMMUNICATION TECHNOLOGIES