Investigation of Methods of Automatic Stitching of Panoramic Images

封面

如何引用文章

全文:

开放存取 开放存取
受限制的访问 ##reader.subscriptionAccessGranted##
受限制的访问 订阅存取

详细

The relevance of panoramic stitching is explained by the fact that powerful computers and image processing algorithms are currently available, which allow you to automatically stitch many images into a panorama with a high degree of accuracy and quality. This makes panoramic stitching an important tool for both professional photographers and amateur photographers, as well as in many other areas related to image processing and computer vision. The leading trend in the development of panoramic stitching is to improve the accuracy and speed of algorithms, as well as to expand the possibilities for working with large amounts of data. One of the directions of its development is the development of tools for creating interactive panoramic images and virtual tours. The paper proposes a method of absolutely automatic stitching of panoramic images using methods of invariant local functions for finding key points and their descriptors, projective transformation using the RANSAC algorithm, image alignment based on the calculation of homographic parameters of the camera, multi-band image mixing. To test the proposed method, a software prototype was implemented, photographs from the Huns exhibition at the M.N. Khangalov Museum of the History of the Republic of Buryatia were taken as experimental data. The results of the software prototype are panoramic images obtained based on the processing of these photos. The conducted computational experiments allow us to conclude that the results obtained show high accuracy when compared with the real world.

全文:

受限制的访问

作者简介

Svetlana Mikhaylova

Financial University under the Government of the Russian Federation

Email: ssmihajlova@fa.ru

Doctor of Economic, Professor, Professor of the Department of Data Analysis and Machine Learning of the Financial University under the Government of the Russian Federation

俄罗斯联邦, Moscow

Soelma Danilova

East Siberia State University of Technology and Management

Email: dan-soelma@yandex.ru

Сandidate of Engineering, Associate Professor; associate professor at the Department of Software Engineering and Artificial Intelligence of the East Siberia State University of Technology and Management

俄罗斯联邦, Ulan-Ude

Natalia Grineva

Financial University under the Government of the Russian Federation

编辑信件的主要联系方式.
Email: ngrineva@fa.ru

Candidate of Economic Sciences, Associate Professor; associate professor of the Department of Data Analysis and Machine Learning of the Financial University under the Government of the Russian Federation

俄罗斯联邦, Moscow

参考

  1. Shcheliski R. Alignment and stitching of images: A textbook. Fundamentals and Trends in Computer Graphics and Vision. 2006. Vol. 2. No. 1. Pp. 1–104.
  2. Milgram D.L. Computer methods of creating photomosaics. IEEE Transactions on Computers. 1975. Vol. 100. No. 11. Pp. 1113–1119.
  3. Brown M., Low D.G. Automatic stitching of panoramic images using invariant functions. International Journal of Computer Vision. 2007. Vol. 74. No. 1. Pp. 59–73.
  4. Chen S.E. Quicktime VR: An image-based approach to navigation in a virtual environment. In: Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Technologies. 1995. Pp. 29–38.
  5. Microsoft Digital Image Pro. URL: http://www.microsoft.com/products/imaging (data of accesses: 25.01.2023).
  6. Hartley R., Zisserman A. Multidimensional geometry in computer vision. Cambridge University Press, 2003. P. 655.
  7. Sheliski R., Shum H.Y. Creation of full-size panoramic images of mosaics and maps of the environment. In: Proceedings of the 24th Annual Conference on Computer graphics and Interactive methods. 1997. Pp. 251–258.
  8. Zaslavsky A.A. Geometric transformations. Moscow: ICNMO. 2004. P. 86.
  9. Shcheliski R., Kang S. B. Direct methods of reconstruction of visual scenes. In: Proceedings of the IEEE Workshop on the representation of visual scenes (in combination with ICCV’95). IEEE. 1995. Pp. 26–33.
  10. Irani M., Anandan P. On direct methods. In: International seminar on vision algorithms. Springer, Berlin, Heidelberg. 1999. Pp. 267–277.
  11. Shum X, Shcheliski R. Constructing a mosaic of a panoramic image with global and local alignment. In: Panoramic vision. Springer. New York. NY. 2001. Pp. 227–268.
  12. Zoglami I., Fojeras O., Deriche R. Using geometric angles to construct a two-dimensional mosaic from a set of images. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and pattern recognition. IEEE. 1997. Pp. 420–425.
  13. Kapel D., Zisserman A. Automated mosaic with super-resolution zoom. In: Proceedings. IEEE Computer Society 1998 Conference on Computer Vision and Pattern Recognition (cat. No. 98CB36231). IEEE. 1998. Pp. 885–891.
  14. McLauchlan PF, Jaenicke A. Mosaic of images using sequential beam tuning. Image and Vision computing. 2002. Vol. 20. No. 9–10. Pp. 751–759.
  15. Harris C. Geometry from visual motion. In: Active vision. MIT press. 1993. Pp. 263–284.
  16. Shi J. And co-author. Good opportunities for tracking. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE. 1994. Pp. 593–600.
  17. Gonzalez R., Woods R. Digital image processing. Moscow: Technosphere, 2005. P. 1072.
  18. Patent SIFT. URL: https://www.google.com/patents/US6711293 (data of accesses: 21.12.2022).
  19. Patent SURF. URL: https://patents.google.com/patent/US20090238460 (data of accesses: 21.12.2022).
  20. Bay H., Tuitelaars T., Van Gool L. Cerf: Accelerated reliable functions. In: European Conference on Computer Vision. Springer. Berlin. Heidelberg. 2006. Pp. 404–417.

补充文件

附件文件
动作
1. JATS XML
2. Fig. 1. General model of automatic image stitching

下载 (49KB)
3. Рис. 2. Поиск и сопоставление ключевых точек

下载 (150KB)
4. Fig. 3. Image composition

下载 (91KB)
5. Fig. 4. Reading images

下载 (70KB)
6. Fig. 5. Search for key points and their descriptors

下载 (61KB)
7. Fig. 6. Сomparison of descriptors

下载 (82KB)
8. Fig. 7. Estimation of images homography

下载 (144KB)
9. Fig. 8. Motion compensation

下载 (192KB)
10. Fig. 9. Wave correction

下载 (82KB)
11. Fig. 10. Multiband mixing

下载 (216KB)
12. Fig. 11. Panorama stitching process

下载 (167KB)
13. Fig. 12. Photos of the exhibition hall

下载 (249KB)
14. Fig. 13. Panoramic image of the exhibition hall

下载 (73KB)
15. Fig. 14. Comparative graph of the found key points (3872 × 2176)

下载 (93KB)
16. Fig. 15. Comparison of the found features (448 × 252)

下载 (87KB)


##common.cookie##