Image Editing based Data Augmentation for Illumination-insensitive Background Subtraction

Sakkos, Dimitris, Ho, Edmond, Shum, Hubert and Elvin, Garry (2023) Image Editing based Data Augmentation for Illumination-insensitive Background Subtraction. Journal of Enterprise Information Management, 36 (3). pp. 818-838. ISSN 1741-0398

JEIM_02_2020_0042.R1_Proof_hi.pdf - Accepted Version

Download (7MB) | Preview
Official URL:


A core challenge in background subtraction (BGS) is handling videos with sudden illumination changes in consecutive frames. While the use of data augmentation has been shown to increase robustness, the modelling of realistic illumination changes remains less explored and is usually limited to global, static brightness adjustments. In this paper, we focus on tackling the problem of background subtraction using augmented training data, and propose an augmentation method which vastly improves the model's performance under challenging illumination conditions. In particular, our framework consists of a local component that considers direct light/shadow and lighting angles, and a global component that considers the overall contrast, sharpness and color saturation of the image. It generates realistic, structured training data with different illumination conditions, enabling our deep learning system to be trained effectively for background subtraction even when significant illumination changes take place. We further propose a post-processing method that removes noise from the output binary map of segmentation, resulting in a cleaner, more accurate segmentation map that can generalise to multiple scenes of different conditions. Experimental results demonstrate that the proposed system outperforms existing work, with the highest F-measure score of 81.27% obtained by the full system. To facilitate the research in the field, we open the source code of this project at:

Item Type: Article
Uncontrolled Keywords: Background subtraction; Convolutional neural networks; Synthetics; Data augmentation; Illumination-invariant
Subjects: G400 Computer Science
Department: Faculties > Engineering and Environment > Computer and Information Sciences
Depositing User: John Coen
Date Deposited: 14 Jul 2020 11:05
Last Modified: 24 May 2023 12:00

Actions (login required)

View Item View Item


Downloads per month over past year

View more statistics