Gaze Estimation Approach Using Deep Differential Residual Network

Huang, Longzhao, Li, Yujie, Wang, Xu, Wang, Haoyu, Bouridane, Ahmed and Chaddad, Ahmad (2022) Gaze Estimation Approach Using Deep Differential Residual Network. Sensors, 22 (14). p. 5462. ISSN 1424-8220

sensors-22-05462-v2.pdf - Published Version
Available under License Creative Commons Attribution 4.0.

Download (7MB) | Preview
Official URL:


Gaze estimation, which is a method to determine where a person is looking at given the person’s full face, is a valuable clue for understanding human intention. Similarly to other domains of computer vision, deep learning (DL) methods have gained recognition in the gaze estimation domain. However, there are still gaze calibration problems in the gaze estimation domain, thus preventing existing methods from further improving the performances. An effective solution is to directly predict the difference information of two human eyes, such as the differential network (Diff-Nn). However, this solution results in a loss of accuracy when using only one inference image. We propose a differential residual model (DRNet) combined with a new loss function to make use of the difference information of two eye images. We treat the difference information as auxiliary information. We assess the proposed model (DRNet) mainly using two public datasets (1) MpiiGaze and (2) Eyediap. Considering only the eye features, DRNet outperforms the state-of-the-art gaze estimation methods with angular-error of 4.57 and 6.14 using MpiiGaze and Eyediap datasets, respectively. Furthermore, the experimental results also demonstrate that DRNet is extremely robust to noise images.

Item Type: Article
Additional Information: Funding information: This work was supported in part by the National Natural Science Foundation of China (61903090), Guangxi Natural Science Foundation (2022GXNSFBA035644) and the Foreign Young Talent Program (QN2021033002L).
Uncontrolled Keywords: gaze estimation, gaze calibration, noise image, differential residual network
Subjects: G500 Information Systems
Department: Faculties > Engineering and Environment > Computer and Information Sciences
Depositing User: Rachel Branson
Date Deposited: 27 Jul 2022 12:34
Last Modified: 27 Jul 2022 12:45

Actions (login required)

View Item View Item


Downloads per month over past year

View more statistics