Recognition of student engagement and affective states using ConvNeXtlarge and ensemble GRU in E-Learning
The advent of online learning has revolutionized the educational landscape, significantly enhancing global access to and affordability of education. However, a critical challenge in this domain is the efficacy of online classes, particularly in the context of the feedback loop between instructors an...
| Main Authors: | , , , , , |
|---|---|
| Format: | Book Section |
| Language: | English |
| Published: |
Institute of Electrical and Electronics Engineers
2024
|
| Online Access: | http://psasir.upm.edu.my/id/eprint/115331/ http://psasir.upm.edu.my/id/eprint/115331/1/115331.pdf |
| _version_ | 1848866748862824448 |
|---|---|
| author | Shiri, Farhad Mortezapour Perumal, Thinagaran Mustapha, Norwati Mohamed, Raihani Ahmadon, Mohd Anuaruddin Yamaguchi, Shingo |
| author_facet | Shiri, Farhad Mortezapour Perumal, Thinagaran Mustapha, Norwati Mohamed, Raihani Ahmadon, Mohd Anuaruddin Yamaguchi, Shingo |
| author_sort | Shiri, Farhad Mortezapour |
| building | UPM Institutional Repository |
| collection | Online Access |
| description | The advent of online learning has revolutionized the educational landscape, significantly enhancing global access to and affordability of education. However, a critical challenge in this domain is the efficacy of online classes, particularly in the context of the feedback loop between instructors and students. A pivotal aspect of this challenge is the assessment of student engagement and other affective states in online learning environments, a task that is inherently complex due to its nuanced nature. In this paper, we introduce a novel spatio-temporal hybrid deep learning model that combines the strengths of ConvNeXtLarge with an ensemble of gated recurrent unit (GRU and Bi-GRU) models to detect and classify affective states of students from video data. This model adeptly handles the multi-label, multi-class nature of the problem, employing four parallel fully connected (Dense) layers for effective classification. Our model's performance is evaluated using the DAiSEE dataset, a publicly available resource that captures a range of student affective states in an online learning environment. The proposed model demonstrates promising results in identifying four key affective states of boredom, engagement, confusion, and frustration, with accuracy rates of 54.89%, 56.46%, 70.18%, and 79.32% respectively. These findings underscore the efficacy of our model in accurately gauging student affective states, thereby offering significant insights into the potential of spatio-temporal hybrid networks in this realm. The study demonstrates the feasibility of employing such models to enhance the quality of online education. |
| first_indexed | 2025-11-15T14:25:32Z |
| format | Book Section |
| id | upm-115331 |
| institution | Universiti Putra Malaysia |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-15T14:25:32Z |
| publishDate | 2024 |
| publisher | Institute of Electrical and Electronics Engineers |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | upm-1153312025-03-03T05:20:33Z http://psasir.upm.edu.my/id/eprint/115331/ Recognition of student engagement and affective states using ConvNeXtlarge and ensemble GRU in E-Learning Shiri, Farhad Mortezapour Perumal, Thinagaran Mustapha, Norwati Mohamed, Raihani Ahmadon, Mohd Anuaruddin Yamaguchi, Shingo The advent of online learning has revolutionized the educational landscape, significantly enhancing global access to and affordability of education. However, a critical challenge in this domain is the efficacy of online classes, particularly in the context of the feedback loop between instructors and students. A pivotal aspect of this challenge is the assessment of student engagement and other affective states in online learning environments, a task that is inherently complex due to its nuanced nature. In this paper, we introduce a novel spatio-temporal hybrid deep learning model that combines the strengths of ConvNeXtLarge with an ensemble of gated recurrent unit (GRU and Bi-GRU) models to detect and classify affective states of students from video data. This model adeptly handles the multi-label, multi-class nature of the problem, employing four parallel fully connected (Dense) layers for effective classification. Our model's performance is evaluated using the DAiSEE dataset, a publicly available resource that captures a range of student affective states in an online learning environment. The proposed model demonstrates promising results in identifying four key affective states of boredom, engagement, confusion, and frustration, with accuracy rates of 54.89%, 56.46%, 70.18%, and 79.32% respectively. These findings underscore the efficacy of our model in accurately gauging student affective states, thereby offering significant insights into the potential of spatio-temporal hybrid networks in this realm. The study demonstrates the feasibility of employing such models to enhance the quality of online education. Institute of Electrical and Electronics Engineers 2024 Book Section PeerReviewed text en http://psasir.upm.edu.my/id/eprint/115331/1/115331.pdf Shiri, Farhad Mortezapour and Perumal, Thinagaran and Mustapha, Norwati and Mohamed, Raihani and Ahmadon, Mohd Anuaruddin and Yamaguchi, Shingo (2024) Recognition of student engagement and affective states using ConvNeXtlarge and ensemble GRU in E-Learning. In: 2024 12th International Conference on Information and Education Technology. Institute of Electrical and Electronics Engineers, pp. 30-34. ISBN 9798350371772 https://ieeexplore.ieee.org/document/10542707/ 10.1109/ICIET60671.2024.10542707 |
| spellingShingle | Shiri, Farhad Mortezapour Perumal, Thinagaran Mustapha, Norwati Mohamed, Raihani Ahmadon, Mohd Anuaruddin Yamaguchi, Shingo Recognition of student engagement and affective states using ConvNeXtlarge and ensemble GRU in E-Learning |
| title | Recognition of student engagement and affective states using ConvNeXtlarge and ensemble GRU in E-Learning |
| title_full | Recognition of student engagement and affective states using ConvNeXtlarge and ensemble GRU in E-Learning |
| title_fullStr | Recognition of student engagement and affective states using ConvNeXtlarge and ensemble GRU in E-Learning |
| title_full_unstemmed | Recognition of student engagement and affective states using ConvNeXtlarge and ensemble GRU in E-Learning |
| title_short | Recognition of student engagement and affective states using ConvNeXtlarge and ensemble GRU in E-Learning |
| title_sort | recognition of student engagement and affective states using convnextlarge and ensemble gru in e-learning |
| url | http://psasir.upm.edu.my/id/eprint/115331/ http://psasir.upm.edu.my/id/eprint/115331/ http://psasir.upm.edu.my/id/eprint/115331/ http://psasir.upm.edu.my/id/eprint/115331/1/115331.pdf |