Investigation of Methods of Automatic Stitching of Panoramic Images

Capa

Citar

Texto integral

Acesso aberto Acesso aberto
Acesso é fechado Acesso está concedido
Acesso é fechado Somente assinantes

Resumo

The relevance of panoramic stitching is explained by the fact that powerful computers and image processing algorithms are currently available, which allow you to automatically stitch many images into a panorama with a high degree of accuracy and quality. This makes panoramic stitching an important tool for both professional photographers and amateur photographers, as well as in many other areas related to image processing and computer vision. The leading trend in the development of panoramic stitching is to improve the accuracy and speed of algorithms, as well as to expand the possibilities for working with large amounts of data. One of the directions of its development is the development of tools for creating interactive panoramic images and virtual tours. The paper proposes a method of absolutely automatic stitching of panoramic images using methods of invariant local functions for finding key points and their descriptors, projective transformation using the RANSAC algorithm, image alignment based on the calculation of homographic parameters of the camera, multi-band image mixing. To test the proposed method, a software prototype was implemented, photographs from the Huns exhibition at the M.N. Khangalov Museum of the History of the Republic of Buryatia were taken as experimental data. The results of the software prototype are panoramic images obtained based on the processing of these photos. The conducted computational experiments allow us to conclude that the results obtained show high accuracy when compared with the real world.

Texto integral

Acesso é fechado

Sobre autores

Svetlana Mikhaylova

Financial University under the Government of the Russian Federation

Email: ssmihajlova@fa.ru

Doctor of Economic, Professor, Professor of the Department of Data Analysis and Machine Learning of the Financial University under the Government of the Russian Federation

Rússia, Moscow

Soelma Danilova

East Siberia State University of Technology and Management

Email: dan-soelma@yandex.ru

Сandidate of Engineering, Associate Professor; associate professor at the Department of Software Engineering and Artificial Intelligence of the East Siberia State University of Technology and Management

Rússia, Ulan-Ude

Natalia Grineva

Financial University under the Government of the Russian Federation

Autor responsável pela correspondência
Email: ngrineva@fa.ru

Candidate of Economic Sciences, Associate Professor; associate professor of the Department of Data Analysis and Machine Learning of the Financial University under the Government of the Russian Federation

Rússia, Moscow

Bibliografia

  1. Shcheliski R. Alignment and stitching of images: A textbook. Fundamentals and Trends in Computer Graphics and Vision. 2006. Vol. 2. No. 1. Pp. 1–104.
  2. Milgram D.L. Computer methods of creating photomosaics. IEEE Transactions on Computers. 1975. Vol. 100. No. 11. Pp. 1113–1119.
  3. Brown M., Low D.G. Automatic stitching of panoramic images using invariant functions. International Journal of Computer Vision. 2007. Vol. 74. No. 1. Pp. 59–73.
  4. Chen S.E. Quicktime VR: An image-based approach to navigation in a virtual environment. In: Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Technologies. 1995. Pp. 29–38.
  5. Microsoft Digital Image Pro. URL: http://www.microsoft.com/products/imaging (data of accesses: 25.01.2023).
  6. Hartley R., Zisserman A. Multidimensional geometry in computer vision. Cambridge University Press, 2003. P. 655.
  7. Sheliski R., Shum H.Y. Creation of full-size panoramic images of mosaics and maps of the environment. In: Proceedings of the 24th Annual Conference on Computer graphics and Interactive methods. 1997. Pp. 251–258.
  8. Zaslavsky A.A. Geometric transformations. Moscow: ICNMO. 2004. P. 86.
  9. Shcheliski R., Kang S. B. Direct methods of reconstruction of visual scenes. In: Proceedings of the IEEE Workshop on the representation of visual scenes (in combination with ICCV’95). IEEE. 1995. Pp. 26–33.
  10. Irani M., Anandan P. On direct methods. In: International seminar on vision algorithms. Springer, Berlin, Heidelberg. 1999. Pp. 267–277.
  11. Shum X, Shcheliski R. Constructing a mosaic of a panoramic image with global and local alignment. In: Panoramic vision. Springer. New York. NY. 2001. Pp. 227–268.
  12. Zoglami I., Fojeras O., Deriche R. Using geometric angles to construct a two-dimensional mosaic from a set of images. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and pattern recognition. IEEE. 1997. Pp. 420–425.
  13. Kapel D., Zisserman A. Automated mosaic with super-resolution zoom. In: Proceedings. IEEE Computer Society 1998 Conference on Computer Vision and Pattern Recognition (cat. No. 98CB36231). IEEE. 1998. Pp. 885–891.
  14. McLauchlan PF, Jaenicke A. Mosaic of images using sequential beam tuning. Image and Vision computing. 2002. Vol. 20. No. 9–10. Pp. 751–759.
  15. Harris C. Geometry from visual motion. In: Active vision. MIT press. 1993. Pp. 263–284.
  16. Shi J. And co-author. Good opportunities for tracking. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE. 1994. Pp. 593–600.
  17. Gonzalez R., Woods R. Digital image processing. Moscow: Technosphere, 2005. P. 1072.
  18. Patent SIFT. URL: https://www.google.com/patents/US6711293 (data of accesses: 21.12.2022).
  19. Patent SURF. URL: https://patents.google.com/patent/US20090238460 (data of accesses: 21.12.2022).
  20. Bay H., Tuitelaars T., Van Gool L. Cerf: Accelerated reliable functions. In: European Conference on Computer Vision. Springer. Berlin. Heidelberg. 2006. Pp. 404–417.

Arquivos suplementares

Arquivos suplementares
Ação
1. JATS XML
2. Fig. 1. General model of automatic image stitching

Baixar (49KB)
3. Рис. 2. Поиск и сопоставление ключевых точек

Baixar (150KB)
4. Fig. 3. Image composition

Baixar (91KB)
5. Fig. 4. Reading images

Baixar (70KB)
6. Fig. 5. Search for key points and their descriptors

Baixar (61KB)
7. Fig. 6. Сomparison of descriptors

Baixar (82KB)
8. Fig. 7. Estimation of images homography

Baixar (144KB)
9. Fig. 8. Motion compensation

Baixar (192KB)
10. Fig. 9. Wave correction

Baixar (82KB)
11. Fig. 10. Multiband mixing

Baixar (216KB)
12. Fig. 11. Panorama stitching process

Baixar (167KB)
13. Fig. 12. Photos of the exhibition hall

Baixar (249KB)
14. Fig. 13. Panoramic image of the exhibition hall

Baixar (73KB)
15. Fig. 14. Comparative graph of the found key points (3872 × 2176)

Baixar (93KB)
16. Fig. 15. Comparison of the found features (448 × 252)

Baixar (87KB)


Este site utiliza cookies

Ao continuar usando nosso site, você concorda com o procedimento de cookies que mantêm o site funcionando normalmente.

Informação sobre cookies