Toward Use of Facial Thermal Features in Dynamic Assessment of Affect and Arousal Level
Automated assessment of affect and arousal level can help psychologists and psychiatrists in clinical diagnoses; and may enable affect-aware robot-human interaction. This work identifies major difficulties in automating affect and arousal assessment and attempts to overcome some of them. It first an...
| Main Authors: | , , |
|---|---|
| Format: | Journal Article |
| Published: |
IEEE Computer Society
2016
|
| Online Access: | http://hdl.handle.net/20.500.11937/22628 |
| _version_ | 1848750922919837696 |
|---|---|
| author | Khan, Masood Mehmood Ward, R. Ingleby, M. |
| author_facet | Khan, Masood Mehmood Ward, R. Ingleby, M. |
| author_sort | Khan, Masood Mehmood |
| building | Curtin Institutional Repository |
| collection | Online Access |
| description | Automated assessment of affect and arousal level can help psychologists and psychiatrists in clinical diagnoses; and may enable affect-aware robot-human interaction. This work identifies major difficulties in automating affect and arousal assessment and attempts to overcome some of them. It first analyzes thermal infrared images to examine how changes in affect and/or arousal level would cause hæmodynamic variations, concentrated along certain facial muscles. These concentrations are used to measure affect/arousal induced facial thermal variations. In step-1 of a 2- step pattern recognition schema, ‘between-affect’ and ‘betweenarousal- level’ variations are used to derive facial thermal features as Principal Components (PCs) of the facial thermal measurements. The most influential of these PCs are used to cluster the feature space for different affects and subsequently assign a set of thermal features to an affect cluster. In step-2, affect clusters are partitioned into high, medium and mild arousal levels. The distance between a test face vector and the centroids of subclusters at three arousal levels belonging to a single affective state, identified from step-1, is used to determine the arousal level of the identified affective state. |
| first_indexed | 2025-11-14T07:44:32Z |
| format | Journal Article |
| id | curtin-20.500.11937-22628 |
| institution | Curtin University Malaysia |
| institution_category | Local University |
| last_indexed | 2025-11-14T07:44:32Z |
| publishDate | 2016 |
| publisher | IEEE Computer Society |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | curtin-20.500.11937-226282017-10-02T06:08:14Z Toward Use of Facial Thermal Features in Dynamic Assessment of Affect and Arousal Level Khan, Masood Mehmood Ward, R. Ingleby, M. Automated assessment of affect and arousal level can help psychologists and psychiatrists in clinical diagnoses; and may enable affect-aware robot-human interaction. This work identifies major difficulties in automating affect and arousal assessment and attempts to overcome some of them. It first analyzes thermal infrared images to examine how changes in affect and/or arousal level would cause hæmodynamic variations, concentrated along certain facial muscles. These concentrations are used to measure affect/arousal induced facial thermal variations. In step-1 of a 2- step pattern recognition schema, ‘between-affect’ and ‘betweenarousal- level’ variations are used to derive facial thermal features as Principal Components (PCs) of the facial thermal measurements. The most influential of these PCs are used to cluster the feature space for different affects and subsequently assign a set of thermal features to an affect cluster. In step-2, affect clusters are partitioned into high, medium and mild arousal levels. The distance between a test face vector and the centroids of subclusters at three arousal levels belonging to a single affective state, identified from step-1, is used to determine the arousal level of the identified affective state. 2016 Journal Article http://hdl.handle.net/20.500.11937/22628 10.1109/TAFFC.2016.2535291 IEEE Computer Society unknown |
| spellingShingle | Khan, Masood Mehmood Ward, R. Ingleby, M. Toward Use of Facial Thermal Features in Dynamic Assessment of Affect and Arousal Level |
| title | Toward Use of Facial Thermal Features in Dynamic Assessment of Affect and Arousal Level |
| title_full | Toward Use of Facial Thermal Features in Dynamic Assessment of Affect and Arousal Level |
| title_fullStr | Toward Use of Facial Thermal Features in Dynamic Assessment of Affect and Arousal Level |
| title_full_unstemmed | Toward Use of Facial Thermal Features in Dynamic Assessment of Affect and Arousal Level |
| title_short | Toward Use of Facial Thermal Features in Dynamic Assessment of Affect and Arousal Level |
| title_sort | toward use of facial thermal features in dynamic assessment of affect and arousal level |
| url | http://hdl.handle.net/20.500.11937/22628 |