A Hierarchical Separation and Classification Network for Dynamic Micro-Expression Classification
Models of seven discrete expressions developed using macro-level facial muscle variations would suffice identifying macro-level expressions of affective states. These models won’t discretise continuous and dynamic micro-level variations in facial expressions. We present a Hierarchical Separation an...
| Main Authors: | , , , , |
|---|---|
| Format: | Journal Article |
| Published: |
2023
|
| Subjects: | |
| Online Access: | Curtin University http://hdl.handle.net/20.500.11937/93940 |
| _version_ | 1848765816621760512 |
|---|---|
| author | Vice, Jordan Khan, Masood Tan, Tele Murray, Iain Yanushkevich, Svetlana |
| author_facet | Vice, Jordan Khan, Masood Tan, Tele Murray, Iain Yanushkevich, Svetlana |
| author_sort | Vice, Jordan |
| building | Curtin Institutional Repository |
| collection | Online Access |
| description | Models of seven discrete expressions developed using macro-level facial muscle variations would suffice identifying macro-level expressions of affective states. These models won’t discretise continuous and dynamic micro-level variations in facial expressions. We present a Hierarchical Separation and Classification Network (HSCN) for discovering dynamic, continuous and macro- and micro-level variations in facial expressions of affective states. In the HSCN, we first invoke an unsupervised cosine similarity-based separation method on continuous facial expression data to extract twenty-one dynamic facial expression classes from the seven common discrete affective states. The between-clusters separation is then optimised for discovering the macro-level changes resulting from facial muscle activations. A following step in the HSCN separates the upper and lower facial regions for realizing changes pertaining to upper and lower facial muscle activations. Data from the two separated facial regions are then clustered in a linear discriminant space using similarities in muscular activation patterns. Next, the actual dynamic expression data are mapped onto discriminant features for developing a rule-based expert system that facilitates classifying twenty-one upper and twenty-one lower micro-expressions. Invoking the random forest algorithm would classify twenty-one macro-level facial expressions with 76.11\% accuracy. A support vector machine (SVM), used separately on upper and lower facial regions in tandem, could classify them with respective accuracies of 73.63\% and 87.68\%. This work demonstrates a novel and effective method of dynamic assessment of affective states. The HSCN further demonstrates that facial muscle variations gathered from either upper-, lower- or full-face would suffice classifying affective states. We also provide new insight into discovery of micro-level facial muscle variations and their utilization in dynamic assessment of facial expressions of affective states. |
| first_indexed | 2025-11-14T11:41:16Z |
| format | Journal Article |
| id | curtin-20.500.11937-93940 |
| institution | Curtin University Malaysia |
| institution_category | Local University |
| last_indexed | 2025-11-14T11:41:16Z |
| publishDate | 2023 |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | curtin-20.500.11937-939402024-01-31T01:31:26Z A Hierarchical Separation and Classification Network for Dynamic Micro-Expression Classification Vice, Jordan Khan, Masood Tan, Tele Murray, Iain Yanushkevich, Svetlana Cosine similarity-based separation, Hierarchical classification, Micro-expression detection, Affective state assessment, Facial expression classification, Rule-based systems Models of seven discrete expressions developed using macro-level facial muscle variations would suffice identifying macro-level expressions of affective states. These models won’t discretise continuous and dynamic micro-level variations in facial expressions. We present a Hierarchical Separation and Classification Network (HSCN) for discovering dynamic, continuous and macro- and micro-level variations in facial expressions of affective states. In the HSCN, we first invoke an unsupervised cosine similarity-based separation method on continuous facial expression data to extract twenty-one dynamic facial expression classes from the seven common discrete affective states. The between-clusters separation is then optimised for discovering the macro-level changes resulting from facial muscle activations. A following step in the HSCN separates the upper and lower facial regions for realizing changes pertaining to upper and lower facial muscle activations. Data from the two separated facial regions are then clustered in a linear discriminant space using similarities in muscular activation patterns. Next, the actual dynamic expression data are mapped onto discriminant features for developing a rule-based expert system that facilitates classifying twenty-one upper and twenty-one lower micro-expressions. Invoking the random forest algorithm would classify twenty-one macro-level facial expressions with 76.11\% accuracy. A support vector machine (SVM), used separately on upper and lower facial regions in tandem, could classify them with respective accuracies of 73.63\% and 87.68\%. This work demonstrates a novel and effective method of dynamic assessment of affective states. The HSCN further demonstrates that facial muscle variations gathered from either upper-, lower- or full-face would suffice classifying affective states. We also provide new insight into discovery of micro-level facial muscle variations and their utilization in dynamic assessment of facial expressions of affective states. 2023 Journal Article http://hdl.handle.net/20.500.11937/93940 10.1109/TCSS.2023.3334823 Curtin University University of Calgary (partial) http://creativecommons.org/licenses/by/4.0/ fulltext |
| spellingShingle | Cosine similarity-based separation, Hierarchical classification, Micro-expression detection, Affective state assessment, Facial expression classification, Rule-based systems Vice, Jordan Khan, Masood Tan, Tele Murray, Iain Yanushkevich, Svetlana A Hierarchical Separation and Classification Network for Dynamic Micro-Expression Classification |
| title | A Hierarchical Separation and Classification Network for Dynamic Micro-Expression Classification |
| title_full | A Hierarchical Separation and Classification Network for Dynamic Micro-Expression Classification |
| title_fullStr | A Hierarchical Separation and Classification Network for Dynamic Micro-Expression Classification |
| title_full_unstemmed | A Hierarchical Separation and Classification Network for Dynamic Micro-Expression Classification |
| title_short | A Hierarchical Separation and Classification Network for Dynamic Micro-Expression Classification |
| title_sort | hierarchical separation and classification network for dynamic micro-expression classification |
| topic | Cosine similarity-based separation, Hierarchical classification, Micro-expression detection, Affective state assessment, Facial expression classification, Rule-based systems |
| url | Curtin University Curtin University http://hdl.handle.net/20.500.11937/93940 |