Development Of An Emotion Recognition System Based On Face Images

Automatic facial expression recognition has vast applications such as sociable robots, intelligent tutoring system, smart home automation system and other human-machine-interaction applications. Thus, the research in facial expression recognition has been growing in interest. However, most approache...

Full description

Bibliographic Details
Main Author: Tan, Yi Chen
Format: Monograph
Language:English
Published: Universiti Sains Malaysia 2017
Subjects:
Online Access:http://eprints.usm.my/52979/
http://eprints.usm.my/52979/1/Development%20Of%20An%20Emotion%20Recognition%20System%20Based%20On%20Face%20Images_Tan%20Yi%20Chen_E3_2017.pdf
_version_ 1848882398215798784
author Tan, Yi Chen
author_facet Tan, Yi Chen
author_sort Tan, Yi Chen
building USM Institutional Repository
collection Online Access
description Automatic facial expression recognition has vast applications such as sociable robots, intelligent tutoring system, smart home automation system and other human-machine-interaction applications. Thus, the research in facial expression recognition has been growing in interest. However, most approaches do not compare the impact of data augmentation methods and the overall error rate is still high. In this project, a facial expression recognition system based on Convolution Neural Network is proposed. The system extracts all relevant information (i.e., features) from two-dimensional digital facial image and classifies the image into one of the universal facial expression (i.e. happiness, surprise, sadness, disgust, fear, anger and neutral). To increase the accuracy of the proposed system, a number of pre-processing are carried out. The training data are augmented by using methods such as adding salt-and-pepper noises, Gaussian noise, brightness variations and flips. The system is evaluated by using widely used JAFFE and CK+ databases and methods such as k-fold cross-validation and cross-database validation. The proposed method achieved good result, which is 84.06% using CK+ database and 77.59% using combined data from CK+ and JAFFE databases. The system achieved the highest accuracy using data augmented with flips, which is increased from 74.40% to 77.17%. Therefore, data augmentation is proven that it can increase the accuracy.
first_indexed 2025-11-15T18:34:17Z
format Monograph
id usm-52979
institution Universiti Sains Malaysia
institution_category Local University
language English
last_indexed 2025-11-15T18:34:17Z
publishDate 2017
publisher Universiti Sains Malaysia
recordtype eprints
repository_type Digital Repository
spelling usm-529792022-06-21T08:10:06Z http://eprints.usm.my/52979/ Development Of An Emotion Recognition System Based On Face Images Tan, Yi Chen T Technology TK Electrical Engineering. Electronics. Nuclear Engineering Automatic facial expression recognition has vast applications such as sociable robots, intelligent tutoring system, smart home automation system and other human-machine-interaction applications. Thus, the research in facial expression recognition has been growing in interest. However, most approaches do not compare the impact of data augmentation methods and the overall error rate is still high. In this project, a facial expression recognition system based on Convolution Neural Network is proposed. The system extracts all relevant information (i.e., features) from two-dimensional digital facial image and classifies the image into one of the universal facial expression (i.e. happiness, surprise, sadness, disgust, fear, anger and neutral). To increase the accuracy of the proposed system, a number of pre-processing are carried out. The training data are augmented by using methods such as adding salt-and-pepper noises, Gaussian noise, brightness variations and flips. The system is evaluated by using widely used JAFFE and CK+ databases and methods such as k-fold cross-validation and cross-database validation. The proposed method achieved good result, which is 84.06% using CK+ database and 77.59% using combined data from CK+ and JAFFE databases. The system achieved the highest accuracy using data augmented with flips, which is increased from 74.40% to 77.17%. Therefore, data augmentation is proven that it can increase the accuracy. Universiti Sains Malaysia 2017-06-01 Monograph NonPeerReviewed application/pdf en http://eprints.usm.my/52979/1/Development%20Of%20An%20Emotion%20Recognition%20System%20Based%20On%20Face%20Images_Tan%20Yi%20Chen_E3_2017.pdf Tan, Yi Chen (2017) Development Of An Emotion Recognition System Based On Face Images. Project Report. Universiti Sains Malaysia, Pusat Pengajian Kejuruteraan Elektrik & Elektronik. (Submitted)
spellingShingle T Technology
TK Electrical Engineering. Electronics. Nuclear Engineering
Tan, Yi Chen
Development Of An Emotion Recognition System Based On Face Images
title Development Of An Emotion Recognition System Based On Face Images
title_full Development Of An Emotion Recognition System Based On Face Images
title_fullStr Development Of An Emotion Recognition System Based On Face Images
title_full_unstemmed Development Of An Emotion Recognition System Based On Face Images
title_short Development Of An Emotion Recognition System Based On Face Images
title_sort development of an emotion recognition system based on face images
topic T Technology
TK Electrical Engineering. Electronics. Nuclear Engineering
url http://eprints.usm.my/52979/
http://eprints.usm.my/52979/1/Development%20Of%20An%20Emotion%20Recognition%20System%20Based%20On%20Face%20Images_Tan%20Yi%20Chen_E3_2017.pdf