Facial Feature Extraction Using a Symmetric Inline Ma-trix-LBP Variant for Emotion Recognition

Babu, Eaby Kollonoor, Mistry, Kamlesh, Anwar, Naveed and Zhang, Li (2022) Facial Feature Extraction Using a Symmetric Inline Ma-trix-LBP Variant for Emotion Recognition. Sensors, 22 (22). p. 8635. ISSN 1424-3210

sensors-22-08635.pdf - Published Version
Available under License Creative Commons Attribution 4.0.

Download (4MB) | Preview
Official URL: https://doi.org/10.3390/s22228635


With a large number of Local Binary Patterns (LBP) variants being currently used today, the sig-nificant and importance of visual descriptors in computer vision applications are prominent. This paper presents a novel visual descriptor, i.e., SIM-LBP. It employs a new matrix technique called the Symmetric Inline Matrix generator method, which acts as a new variant of LBP. The key feature that separates our variant from existing counterparts is that our variant is very efficient in extracting facial expression features like eyes, eye brows, nose and mouth in a wide range of lighting con-ditions. For testing our model, we applied SIM-LBP on the JAFFE dataset to convert all the images to its corresponding SIM-LBP transformed variant. These transformed images are then used to train a Convolution Neural Network (CNN) based deep learning model for facial expressions recog-nition (FER). Several performance evaluation metrics, i.e., recognition accuracy rate, precision, recall, and F1-score, were used to test mode efficiency in comparison with those using the tradi-tional LBP descriptor and other LBP variants. Our model outperformed in all four matrices with the proposed SIM-LBP transformation on the input images against those of baseline methods. In comparison analysis with the other state-of-the-art methods, it shows the usefulness of the pro-posed SIM-LBP model. Our proposed SIM-LBP variant transformation can also be applied on facial images to identify a person’s mental states and predict mood variations.

Item Type: Article
Uncontrolled Keywords: facial expression recognition, local binary patterns, adaptive image transformation, image encoding, coded visual descriptors
Subjects: G400 Computer Science
Department: Faculties > Engineering and Environment > Computer and Information Sciences
Depositing User: Rachel Branson
Date Deposited: 09 Nov 2022 11:35
Last Modified: 09 Nov 2022 11:45
URI: https://nrl.northumbria.ac.uk/id/eprint/50586

Actions (login required)

View Item View Item


Downloads per month over past year

View more statistics