Intelligent facial emotion recognition using a layered encoding cascade optimization model

Neoh, Siew Chin, Zhang, Li, Mistry, Kamlesh, Hossain, Alamgir, Lim, Chee Peng, Aslam, Nauman and Kinghorn, Philip (2015) Intelligent facial emotion recognition using a layered encoding cascade optimization model. Applied Soft Computing, 34. pp. 72-93. ISSN 1568-4946

Full text not available from this repository. (Request a copy)

Abstract

In this research, we propose a facial expression recognition system with a layered encoding cascade optimization model. Since generating an effective facial representation is a vital step to the success of facial emotion recognition, a modified Local Gabor Binary Pattern operator is first employed to derive a refined initial face representation and we then propose two evolutionary algorithms for feature optimization including (i) direct similarity and (ii) Pareto-based feature selection, under the layered cascade model. The direct similarity feature selection considers characteristics within the same emotion category that give the minimum within-class variation while the Pareto-based feature optimization focuses on features that best represent each expression category and at the same time provide the most distinctions to other expressions. Both a neural network and an ensemble classifier with weighted majority vote are implemented for the recognition of seven expressions based on the selected optimized features. The ensemble model also automatically updates itself with the most recent concepts in the data. Evaluated with the Cohn-Kanade database, our system achieves the best accuracies when the ensemble classifier is applied, and outperforms other research reported in the literature with 96.8% for direct similarity based optimization and 97.4% for the Pareto-based feature selection. Cross-database evaluation with frontal images from the MMI database has also been conducted to further prove system efficiency where it achieves 97.5% for Pareto-based approach and 90.7% for direct similarity-based feature selection and outperforms related research for MMI. When evaluated with 90 degrees side-view images extracted from the videos of the MMI database, the system achieves superior performances with >80% accuracies for both optimization algorithms. Experiments with other weighting and meta-learning combination methods for the construction of ensembles are also explored with our proposed ensemble showing great adpativity to new test data stream for cross-database evaluation. In future work, we aim to incorporate other filtering techniques and evolutionary algorithms into the optimization models to further enhance the recognition performance.

Item Type:	Article
Uncontrolled Keywords:	Facial expression recognition; Feature selection; Cascade optimization; Layered representation structure; Evolutionary algorithm; Ensemble classifier
Subjects:	G400 Computer Science
Department:	Faculties > Engineering and Environment > Computer and Information Sciences
Depositing User:	Becky Skoyles
Date Deposited:	31 Jul 2015 11:29
Last Modified:	12 Oct 2019 22:30
URI:	http://nrl.northumbria.ac.uk/id/eprint/23472

Downloads