Topology Design for Data Center Networks Using Deep Reinforcement Learning

Qi, Haoran, Shu, Zhan and Chen, Xiaomin (2023) Topology Design for Data Center Networks Using Deep Reinforcement Learning. In: The 37th International Conference on Information Networking (ICOIN). International Conference on Information Networking . IEEE, Piscataway, US, pp. 251-256. ISBN 9781665462693, 9781665462686

Preview

Text m53532_qi_final.pdf - Accepted Version Download (606kB) | Preview

Abstract

This paper is concerned with the topology design of data center networks (DCNs) for low latency and fewer links using deep reinforcement learning (DRL). Starting from a Kvertex-connected graph, we propose an interactive framework with single-objective and multi-objective DRL agents to learn DCN topologies for given node traffic matrices by choosing link matrices to represent the states and actions as well as using the average shortest path length together with action penalty terms as reward feedback. Comparisons with commonly used DCN topologies are given to show the effectiveness and merits of our method. The results reveal that our learned topologies could achieve lower delay compared with common DCN topologies. Moreover, we believe that the method can be extended to other topology metrics, e.g., throughput, by simply modifying the reward functions.

Actions (login required)

View Item

Downloads