Deep reinforcement learning-based long-range autonomous valet parking for smart cities

Khalid, Muhammad, Wang, Liang, Wang, Kezhi, Aslam, Nauman, Pan, Cunhua and Cao, Yue (2023) Deep reinforcement learning-based long-range autonomous valet parking for smart cities. Sustainable Cities and Society, 89. p. 104311. ISSN 2210-6707

1-s2.0-S2210670722006151-main.pdf - Published Version
Available under License Creative Commons Attribution Non-commercial No Derivatives 4.0.

Download (1MB) | Preview
Official URL:


In this paper, to reduce the congestion rate at the city center and increase the traveling quality of experience (QoE) of each user, the framework of long-range autonomous valet parking is presented. Here, an Autonomous Vehicle (AV) is deployed to pick up, and drop off users at their required spots, and then drive to the car park around well-organized places of city autonomously. In this framework, we aim to minimize the overall distance of AV, while guarantee all users are served with great QoE, i.e., picking up, and dropping off users at their required spots through optimizing the path planning of the AV and number of serving time slots. To this end, we first present a learning-based algorithm, which is named as Double-Layer Ant Colony Optimization (DLACO) algorithm to solve the above problem in an iterative way. Then, to make the fast decision, while considers the dynamic environment (i.e., the AV may pick up and drop off users from different locations), we further present a deep reinforcement learning-based algorithm, i.e., Deep Q-learning Network (DQN) to solve this problem. Experimental results show that the DL-ACO and DQN-based algorithms both achieve the considerable performance.

Item Type: Article
Additional Information: Funding Information: Funding: Wuhan Key Research and Development Program (2022012202015016)
Uncontrolled Keywords: Ant colony optimization (ACO), Autonomous vehicle, Deep reinforcement learning, Long-range autonomous valet parking (LAVP), Sustainable cities and communities
Subjects: G900 Others in Mathematical and Computing Sciences
H200 Civil Engineering
H800 Chemical, Process and Energy Engineering
Department: Faculties > Engineering and Environment > Computer and Information Sciences
Depositing User: Rachel Branson
Date Deposited: 13 Jan 2023 12:07
Last Modified: 13 Jan 2023 12:15

Actions (login required)

View Item View Item


Downloads per month over past year

View more statistics