Topology Design for Data Center Networks Using Deep Reinforcement Learning

Qi, Haoran, Shu, Zhan and Chen, Xiaomin (2022) Topology Design for Data Center Networks Using Deep Reinforcement Learning. In: The 37th International Conference on Information Networking (ICOIN). IEEE, Piscataway, US. (In Press)

[img]
Preview
Text
m53532_qi_final.pdf - Accepted Version

Download (606kB) | Preview

Abstract

This paper is concerned with the topology design of data center networks (DCNs) for low latency and fewer links using deep reinforcement learning (DRL). Starting from a Kvertex-connected graph, we propose an interactive framework with single-objective and multi-objective DRL agents to learn DCN topologies for given node traffic matrices by choosing link matrices to represent the states and actions as well as using the average shortest path length together with action penalty terms as reward feedback. Comparisons with commonly used DCN topologies are given to show the effectiveness and merits of our method. The results reveal that our learned topologies could achieve lower delay compared with common DCN topologies. Moreover, we believe that the method can be extended to other topology metrics, e.g., throughput, by simply modifying the reward functions.

Item Type: Book Section
Additional Information: ICOIN 2023: The 37th International Conference on Information Networking (ICOIN); Bangkok, Thailand, 11-14 Jan 2023
Uncontrolled Keywords: Low-latency Data Center Network Topology, Deep Reinforcement Learning, Multi-objective Learning
Subjects: G400 Computer Science
Department: Faculties > Engineering and Environment > Computer and Information Sciences
Related URLs:
Depositing User: John Coen
Date Deposited: 10 Jan 2023 12:18
Last Modified: 10 Jan 2023 12:30
URI: https://nrl.northumbria.ac.uk/id/eprint/51118

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics