Neural Networks in the Task of Genre Classification of Musical Compositions

Capa

Citar

Texto integral

Acesso aberto Acesso aberto
Acesso é fechado Acesso está concedido
Acesso é fechado Somente assinantes

Resumo

This study investigates the application of neural networks in the task of classifying audio signals into ten different genres. The peculiarities of processing audio signals in the digital environment are examined, along with the relationship between Fourier transformation and spectrograms, and the characteristics of audio signals. Neural network training was conducted using the GTZAN dataset, which contains 1000 compositions. Four comparable datasets were formed based on this dataset, and the performance of three neural network architectures – convolutional, recurrent, and multilayer perceptron – was evaluated on each of them. The practical significance of this work lies in the possibility of forming musical recommendations and organizing music. The goal of the study is to develop a classifier that could accurately determine the probability of a composition belonging to one of the ten genres.

Texto integral

Acesso é fechado

Sobre autores

Mikhail Belenkiy

Financial University under the Government of the Russian Federation

Autor responsável pela correspondência
Email: michael.belenkiy@yandex.ru
ORCID ID: 0009-0005-9079-9489

student, Faculty of Information Technology and Big Data Analysis

Rússia, Moscow

Natalia Grineva

Financial University under the Government of the Russian Federation

Email: ngrineva@fa.ru
ORCID ID: 0000-0001-7647-5967

Cand. Sci. (Econ.), Associate Professor, associate professor, Department of Data Analysis and Machine Learning

Rússia, Moscow

Bibliografia

  1. Silla C.N., Koerich A.L., Kaestner C.A.A. A feature selection approach for automatic music genre classification. International Journal of Semantic Computing. 2009. No. 03. Pp. 183–208.
  2. Geoffroy P. A large set of audio features for sound description (similarity and classification). In: CUIDADO Project. 2004.
  3. Silla C., Koerich A., Kaestner C. A machine learning approach to automatic music genre classification». Journal of the Brazilian Computer Society. 2008. Vol. 14. No. 3.
  4. Tzanetakis G., Cook P. MARSYAS: A framework for audio analysis. Organised Sound. 2000. No. 4 (3). Pp. 169–175.
  5. Tzanetakis G., Essl G., Cook P. Automatic musical genre classification of audio signals. In: Proc. Int. Symp. Music Information Retrieval (ISMIR). Oct. 2001.
  6. Tzanetakis G., Cook P. Musical genre classification of audio signals. IEEE Transactions on Speech and Audio Processing. 2002. Vol. 10. No. 5. Pp. 293–302.
  7. Choi K., Fazekas G., Sandler M. Automatic tagging using deep convolutional neural networks. In: Intl. Society for Music Information Retrieval Conf. (ISMIR). 2016.
  8. Choi K., Fazekas G., Sandler M., Cho K. Convolutional recurrent neural networks for music classification. 2016.
  9. Rafi Q.G., Noman M., Prodhan S.Z. et al. Comparative analysis of three improved deep learning architectures for music genre classification. International Journal of Information Technology and Computer Science. 2021. No. 13. Pp. 1–14.
  10. Van den Oord A., Dieleman S., Schrauwen B. Deep content-based music recommendation. In: Advances in Neural Information Processing Systems. 2013. Pp. 2643–2651.
  11. Van den Oord A., Dieleman S., Schrauwen B. Transfer learning by supervised pre-training for audio-based music classification. In: Conference of the International Society for Music Information Retrieval, (ISMIR 2014). 2014.
  12. Vaibhavi M., Krishna P.R. Music genre classification using neural networks with data augmentation. 2021.
  13. Crème M., Burlin C., Lenain R. Music genre classification. Stanford University, December 15, 2016.

Arquivos suplementares

Arquivos suplementares
Ação
1. JATS XML
2. Fig. 1. Audio oscillogram

Baixar (112KB)
3. Fig. 2. Fourier Transform

Baixar (26KB)
4. Fig. 3. Audio spectrogram

Baixar (391KB)
5. Fig. 4. Window Functions for STFT

Baixar (88KB)
6. Fig. 5. Mel-spectrogram

Baixar (269KB)
7. Fig. 6. Spectral centroid

Baixar (96KB)
8. Fig. 7. Spectral bandwidth for p = 2, 3, and 4

Baixar (123KB)
9. Fig. 8. Spectral rolloff

Baixar (97KB)
10. Fig. 9. Spectral flux

Baixar (97KB)
11. Fig. 10. Zero Crossing Rate

Baixar (121KB)
12. Fig. 11. Low Energy Feature

Baixar (133KB)
13. Fig. 12. MFCC coefficients extraction algorithm

Baixar (17KB)
14. Fig. 13. MFCC coefficients (1–5)

Baixar (30KB)
15. Fig. 14. Convolutional neural network (CNN) architecture

Baixar (71KB)
16. Fig. 15. Multilayer perceptron (MLP) architecture

Baixar (76KB)
17. Fig. 16. Confusion matrix for CNN model

Baixar (41KB)
18. Fig. 17. Confusion matrix for MLP model

Baixar (41KB)


Este site utiliza cookies

Ao continuar usando nosso site, você concorda com o procedimento de cookies que mantêm o site funcionando normalmente.

Informação sobre cookies