Facial Feature Extraction Using a Symmetric Inline Ma-trix-LBP Variant for Emotion Recognition

Babu, Eaby Kollonoor, Mistry, Kamlesh, Anwar, Naveed and Zhang, Li (2022) Facial Feature Extraction Using a Symmetric Inline Ma-trix-LBP Variant for Emotion Recognition. Sensors, 22 (22). p. 8635. ISSN 1424-3210

Preview

Text sensors-22-08635.pdf - Published Version Available under License Creative Commons Attribution 4.0. Download (4MB) | Preview

Abstract

With a large number of Local Binary Patterns (LBP) variants being currently used today, the sig-nificant and importance of visual descriptors in computer vision applications are prominent. This paper presents a novel visual descriptor, i.e., SIM-LBP. It employs a new matrix technique called the Symmetric Inline Matrix generator method, which acts as a new variant of LBP. The key feature that separates our variant from existing counterparts is that our variant is very efficient in extracting facial expression features like eyes, eye brows, nose and mouth in a wide range of lighting con-ditions. For testing our model, we applied SIM-LBP on the JAFFE dataset to convert all the images to its corresponding SIM-LBP transformed variant. These transformed images are then used to train a Convolution Neural Network (CNN) based deep learning model for facial expressions recog-nition (FER). Several performance evaluation metrics, i.e., recognition accuracy rate, precision, recall, and F1-score, were used to test mode efficiency in comparison with those using the tradi-tional LBP descriptor and other LBP variants. Our model outperformed in all four matrices with the proposed SIM-LBP transformation on the input images against those of baseline methods. In comparison analysis with the other state-of-the-art methods, it shows the usefulness of the pro-posed SIM-LBP model. Our proposed SIM-LBP variant transformation can also be applied on facial images to identify a person’s mental states and predict mood variations.

Actions (login required)

View Item

Downloads