Hierarchical traffic sign recognition system

Cover Page

Cite item

Full Text

Abstract

A hierarchical system of classifiers for recognizing traffic signs from their images is proposed in the article. Only signs that fit into a square are considered. The traffic signs set is analyzed by their shape, color and basic features. A hierarchy of classes for traffic signs on the details of their images is proposed. The traffic sign image recognition algorithm uses this hierarchy. The algorithm only works with localized signs. The localization algorithm is not considered. Image preprocessing is performed at each level of the hierarchy for traffic sign features. Different classifiers are used at different levels of the hierarchy. Preprocessing at the first level uses the segmentation method. Signs are classified by their form in the first level. The edge segment is highlighted in the image of the traffic sign. The Euclidean distance in color space is used to calculate the edge segment. The edge segment outline defines the shape of the sign. Classification of the sign by its shape is carried out based on comparison with the standards. The classifier defines the pattern closest to the sign contour. The efficiency of the classification in the first level is 99.8 %. The second level classifies signs by the color of the edge segment. The effectiveness of this classification is close to 100 %. Internal sign images are obtained after the edge segment is removed from the image. The following levels classify by internal images. These classifiers use artificial neural networks. The efficiency of the system on the GTSRB collection is 98 %.

About the authors

S. V. Belim

Omsk State Technical University; Siberian State Automobile and Highway University

Author for correspondence.
Email: sbelim@mail.ru

Dr. Sc., Professor

Russian Federation, Omsk; Omsk

E. V. Khiryanov

Siberian State Automobile and Highway University

Email: hiryanove@mail.ru

Postgraduate Student

Russian Federation, Omsk

References

  1. Ellahyani A., El Ansari M. Mean shift and logpolar transform for road sign detection, Multimedia Tools and Applications, 2017, vol. 76(22), pp. 24495—24513.
  2. Bouti A., Med A. M., Riffi J., Tairi H. A robust system for road sign detection and classification using lenet architecture based on convolutional neural network, Soft Computing, 2019, vol. 7, pp. 1—13.
  3. Salti S., Petrelli A., Tombari F., Fioraio N., Di Stefano L. Traffic sign detection via interest region extraction, Pattern Recognition. 2015, vol. 48(4), pp. 1039—1049.
  4. Miura J., Kanda T., Shirai Y. An active vision system for real-time traffic sign recognition, 2000 IEEE Intelligent Transportation Systems Proceedings, 2000, pp. 52—57.
  5. Ellahyani A., El Ansari M., El Jaafari I. Traffic sign detection and recognition based on random forests. Applied Soft Computing, 2016, vol. 46, pp. 805—815.
  6. Zhu Z., Liang D., Zhang S., Huang X., Li B., Hu S. Traffic sign detection and classification in the wild, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2016, pp. 2110—2118.
  7. Stallkamp J., Schlipsing M., Salmen J., Igel C. Man vs. computer: benchmarking machine learning algorithms for traffic sign recognition, Neural Network, 2012, vol. 32, pp. 323—332.
  8. Ciresan D., Meier U., Masci J., Schmidhuber J. Multicolumn deep neural network for traffic sign classification. Neural Networks, 2012, vol. 32, pp. 333—338.
  9. Garcia A. A., Alvarez J. A., Soria-Morillo L. M. Deep neural network for traffic sign recognition systems: An analysis of spatial transformers and stochastic optimisation methods, Neural Networks, 2018, vol. 99, pp. 158—165.
  10. Jaderberg M., Simonyan K., Zisserman A., Kavukcuoglu K. Spatial Transformer Networks, Advances in Neural Information Processing Systems (NIPS 2015), 2015, pp. 1—9.
  11. Saha S., Kamran S. A., Sabbir A. S. Total recall: Understanding traffic signs using deep hierarchical convolutional neural networks, 21st international conference of computer and information technology (ICCIT), 2018, pp. 1—6.
  12. Mao X., Hijazi S. L., Casas R. A., Kaul P., Kumar R., Rowen C. Hierarchical cnn for traffic sign recognition, IEEE intelligent vehicles symposium, 2016, pp. 130—135.
  13. Zhang J., Wang W., Lu C., Wang J., Sangaiah A. K. Lightweight deep network for traffic sign classification, Annals of Telecommunications, 2020, iss. 7—8, pp. 369—379.
  14. Jose A., Thodupunoori H., Nair B. B. A novel traffic sign recognition system combining viola-jones framework and deep learning, Proceedings of the international conference on soft computing and signal processing (ICSCSP), 2018, pp. 507—517.
  15. Li Y., Ma L, Huang Y., Li J. Segment-based traffic sign detection from mobile laser scanning data, Proceedings of the 38th Annual IEEE international geoscience and remote sensing symposium (IGARSS), 2018, pp. 4607—4610.
  16. Ruta A., Li Y., Liu X. Real-time traffic sign recognition from video by class-specific discriminative features, Pattern Recognition, 2010, vol. 43(1), pp. 416—430.
  17. Lillo-Castellano J. M., Mora-Jiménez I., Figuera-Pozuelo C., Rojo Alvarez J. L. Traffic sign segmentation and classification using statistical learning methods, Neurocomputing, 2015, vol. 153, pp. 286—299.
  18. Li L., Mu X., Li S., Peng H. A review of face recognition technology, IEEE Access, 2020, vol. 8, pp. 139110—139120.
  19. Saidallah M., Taki F., Alaoui A. E. B. E., Fergougui A. E. Classification and comparison of license plates localization algorithms, Signal & Image Processing: An International Journal, 2021, vol. 12(2), pp. 1—11.

Supplementary files

Supplementary Files
Action
1. JATS XML
Download

Copyright (c) 2022 Informacionnye Tehnologii


СМИ зарегистрировано Федеральной службой по надзору в сфере связи, информационных технологий и массовых коммуникаций (Роскомнадзор).
Регистрационный номер и дата принятия решения о регистрации СМИ: серия ПИ № 77 - 15565 от 02 июня 2003 г.