Deep Q‐network implementation for simulated autonomous vehicle control

Quek, Yang Thee, Koh, Li Ling, Koh, Ngiap Tiam, Tso, Wai Ann and Woo, Wai Lok (2021) Deep Q‐network implementation for simulated autonomous vehicle control. IET Intelligent Transport Systems, 15 (7). pp. 875-885. ISSN 1751-956X

Text (Advance online version)
itr2.12067.pdf - Published Version
Available under License Creative Commons Attribution 4.0.

Download (2MB) | Preview
Text (Final published version)
Final published version.pdf - Published Version
Available under License Creative Commons Attribution 4.0.

Download (2MB) | Preview
Official URL:


Deep reinforcement learning is poised to be a revolutionised step towards newer possibilities in solving navigation and autonomous vehicle control tasks. Deep Q‐network (DQN) is one of the more popular methods of deep reinforcement learning that allows the agent that controls the vehicle to learn through its mistakes based on its actions and interactions with the environment. This paper presents the implementation of DQN to an autonomous self‐driving vehicle control in two different simulated environments; first environment is in Python which is a simple 2D environment and then advanced to Unity software separately which is a 3D environment. Based on the scores and pixel inputs, the agent in the vehicle learns and adapts to its surrounding. It develops the best solution strategy to direct itself in the environment where its task is to manoeuvre the vehicle from point to point on a simulated highway scenario. The implemented DQN technique approximates the action value function with convolutional neural network. This evaluates the Q‐function for the Q‐learning architecture and updates the action value function. This paper shows that DQN is an effective learning method for the agent of an autonomous vehicle. In both simulated environments, the autonomous vehicle gradually learnt the manoeuvre operations and progressively gained the ability to successfully navigate itself and avoid obstacles without prior information of the surrounding.

Item Type: Article
Uncontrolled Keywords: General Environmental Science, Law, Mechanical Engineering, Transportation
Subjects: G400 Computer Science
G600 Software Engineering
Department: Faculties > Engineering and Environment > Computer and Information Sciences
Depositing User: John Coen
Date Deposited: 07 May 2021 08:02
Last Modified: 31 Jul 2021 10:35

Actions (login required)

View Item View Item


Downloads per month over past year

View more statistics