Stacked Auto Encoder Based Deep Reinforcement Learning for Online Resource Scheduling in Large-Scale MEC Networks

Jiang, Feibo, Wang, Kezhi, Dong, Li, Pan, Cunhua and Yang, Kun (2020) Stacked Auto Encoder Based Deep Reinforcement Learning for Online Resource Scheduling in Large-Scale MEC Networks. IEEE Internet of Things Journal. p. 1. ISSN 2372-2541 (In Press)

[img]
Preview
Text
Stacked Auto Encoder Based Deep Reinforcement Learning for Online Resource Scheduling in Large-Scale MEC Networks.pdf - Accepted Version

Download (1MB) | Preview
Official URL: https://doi.org/10.1109/jiot.2020.2988457

Abstract

An online resource scheduling framework is proposed for minimizing the sum of weighted task latency for all the Internet of things (IoT) users, by optimizing offloading decision, transmission power and resource allocation in the large-scale mobile edge computing (MEC) system. Towards this end, a deep reinforcement learning (DRL) based solution is proposed, which includes the following components. Firstly, a related and regularized stacked auto encoder (2r-SAE) with unsupervised learning is applied to perform data compression and representation for high dimensional channel quality information (CQI) data, which can reduce the state space for DRL. Secondly, we present an adaptive simulated annealing based approach (ASA) as the action search method of DRL, in which an adaptive h-mutation is used to guide the search direction and an adaptive iteration is proposed to enhance the search efficiency during the DRL process. Thirdly, a preserved and prioritized experience replay (2p-ER) is introduced to assist the DRL to train the policy network and find the optimal offloading policy. Numerical results are provided to demonstrate that the proposed algorithm can achieve near-optimal performance while significantly decreasing the computational time compared with existing benchmarks.

Item Type: Article
Uncontrolled Keywords: Stacked auto encoder, deep reinforcement learning, adaptive simulated annealing, large-scale mobile edge computing
Subjects: G400 Computer Science
G500 Information Systems
G600 Software Engineering
G900 Others in Mathematical and Computing Sciences
Department: Faculties > Engineering and Environment > Computer and Information Sciences
Depositing User: John Coen
Date Deposited: 14 May 2020 08:36
Last Modified: 17 Sep 2020 08:30
URI: http://nrl.northumbria.ac.uk/id/eprint/43133

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics