Speech emotion recognition using spectrogram based neural structured learning
Human emotions are extremely crucial in our daily life. Emotion analysis based solely on auditory data is difficult due to the lack of visible visual information on human faces. Thus, a unique emotion recognition system based on robust characteristics and machine learning from the audio speech is re...
| Main Authors: | , , |
|---|---|
| Format: | Conference or Workshop Item |
| Language: | English English |
| Published: |
Universiti Malaysia Pahang
2022
|
| Subjects: | |
| Online Access: | http://umpir.ump.edu.my/id/eprint/36833/ http://umpir.ump.edu.my/id/eprint/36833/1/Speech%20emotion%20recognition%20using%20spectrogram%20based%20neural%20structured%20learning.pdf http://umpir.ump.edu.my/id/eprint/36833/7/Speech%20Emotion%20Recognition%20Using%20Spectrogram%20Based%20Neural%20Structured_FULL.pdf |
| _version_ | 1848825096952610816 |
|---|---|
| author | Sivan, Dawn Haripriya, P. H. Jose, Rajan |
| author_facet | Sivan, Dawn Haripriya, P. H. Jose, Rajan |
| author_sort | Sivan, Dawn |
| building | UMP Institutional Repository |
| collection | Online Access |
| description | Human emotions are extremely crucial in our daily life. Emotion analysis based solely on auditory data is difficult due to the lack of visible visual information on human faces. Thus, a unique emotion recognition system based on robust characteristics and machine learning from the audio speech is reported in this paper. Audio details are used as input to the person-independent emotion recognition system, from which the spectrogram values are extracted as features. The generated features are then used to train and understand the emotions via Neural Structured Learning (NSL), a fast and accurate deep learning approach. During studies on an emotion dataset of audio speeches, the proposed approach of integrating spectrogram and NSL produced improved recognition rates compared to other known models. The system can be used in smart environments like homes or clinics to provide effective healthcare, music recommendations, customer support, and marketing, among several other things. As a result, rather than processing data and making judgments from far distant data sources, the decision-making could be made closer to where the data lives. The Toronto Emotional Speech Set (TESS) dataset that contains 7 emotions has been used for this research. The algorithm is successfully tested with the dataset with an accuracy of ~97%. |
| first_indexed | 2025-11-15T03:23:30Z |
| format | Conference or Workshop Item |
| id | ump-36833 |
| institution | Universiti Malaysia Pahang |
| institution_category | Local University |
| language | English English |
| last_indexed | 2025-11-15T03:23:30Z |
| publishDate | 2022 |
| publisher | Universiti Malaysia Pahang |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | ump-368332023-02-07T02:37:10Z http://umpir.ump.edu.my/id/eprint/36833/ Speech emotion recognition using spectrogram based neural structured learning Sivan, Dawn Haripriya, P. H. Jose, Rajan HD28 Management. Industrial Management Q Science (General) T Technology (General) Human emotions are extremely crucial in our daily life. Emotion analysis based solely on auditory data is difficult due to the lack of visible visual information on human faces. Thus, a unique emotion recognition system based on robust characteristics and machine learning from the audio speech is reported in this paper. Audio details are used as input to the person-independent emotion recognition system, from which the spectrogram values are extracted as features. The generated features are then used to train and understand the emotions via Neural Structured Learning (NSL), a fast and accurate deep learning approach. During studies on an emotion dataset of audio speeches, the proposed approach of integrating spectrogram and NSL produced improved recognition rates compared to other known models. The system can be used in smart environments like homes or clinics to provide effective healthcare, music recommendations, customer support, and marketing, among several other things. As a result, rather than processing data and making judgments from far distant data sources, the decision-making could be made closer to where the data lives. The Toronto Emotional Speech Set (TESS) dataset that contains 7 emotions has been used for this research. The algorithm is successfully tested with the dataset with an accuracy of ~97%. Universiti Malaysia Pahang 2022-11-15 Conference or Workshop Item PeerReviewed pdf en http://umpir.ump.edu.my/id/eprint/36833/1/Speech%20emotion%20recognition%20using%20spectrogram%20based%20neural%20structured%20learning.pdf pdf en http://umpir.ump.edu.my/id/eprint/36833/7/Speech%20Emotion%20Recognition%20Using%20Spectrogram%20Based%20Neural%20Structured_FULL.pdf Sivan, Dawn and Haripriya, P. H. and Jose, Rajan (2022) Speech emotion recognition using spectrogram based neural structured learning. In: The 6th National Conference for Postgraduate Research (NCON-PGR 2022) , 15 November 2022 , Virtual Conference, Universiti Malaysia Pahang, Malaysia. p. 80.. (Published) https://ncon-pgr.ump.edu.my/index.php/en/?option=com_fileman&view=file&routed=1&name=E-BOOK%20NCON%202022%20.pdf&folder=E-BOOK%20NCON%202022&container=fileman-files |
| spellingShingle | HD28 Management. Industrial Management Q Science (General) T Technology (General) Sivan, Dawn Haripriya, P. H. Jose, Rajan Speech emotion recognition using spectrogram based neural structured learning |
| title | Speech emotion recognition using spectrogram based neural structured learning |
| title_full | Speech emotion recognition using spectrogram based neural structured learning |
| title_fullStr | Speech emotion recognition using spectrogram based neural structured learning |
| title_full_unstemmed | Speech emotion recognition using spectrogram based neural structured learning |
| title_short | Speech emotion recognition using spectrogram based neural structured learning |
| title_sort | speech emotion recognition using spectrogram based neural structured learning |
| topic | HD28 Management. Industrial Management Q Science (General) T Technology (General) |
| url | http://umpir.ump.edu.my/id/eprint/36833/ http://umpir.ump.edu.my/id/eprint/36833/ http://umpir.ump.edu.my/id/eprint/36833/1/Speech%20emotion%20recognition%20using%20spectrogram%20based%20neural%20structured%20learning.pdf http://umpir.ump.edu.my/id/eprint/36833/7/Speech%20Emotion%20Recognition%20Using%20Spectrogram%20Based%20Neural%20Structured_FULL.pdf |