e-Prime - Advances in Electrical Engineering Electronics and Energy · 2022 · 13 citations · 21 references
ComputingComputer ScienceComputer SystemsComputer NetworksMachine LearningMarkov Decision ProcessesDeep LearningLoad BalancingNetwork OptimizationPolicy LearningReinforcement LearningSoftware-defined NetworkingDeep Reinforcement LearningExperience ReplayLoad Balancing In SwitchesNetwork Performance OptimizationQ-learningReplaySoftware-defined Networking MigrationSystem State Analysis
In Software-Defined Network (SDN) with multiple controllers, static mapping relationship between switches and controllers may cause some controllers to be overloaded, while some controller resources are underutilized. A Deep Reinforcement Learning-based switch migration strategy (DRL-SMS) is proposed to solve the load imbalance problem in the multi-controller control plane. Based on Markov Decision Process (MDP), modeling analysis is performed for SDN to obtain system state, migration action set, and system reward. Q-values of switch migration actions are obtained by fitting approximate function using Double Deep Q-Network (DDQN), and then the DDQN is trained by using the experience replay mechanism to optimize Q-Network parameters. After training, the DRL-based strategy calculates the Q-value in the current system state and selects the migration action corresponding to the maximum Q-value to perform switch migration. Simulation experiments show that DRL-SMS can effectively balance the controller load and significantly reduce the balance time.
21
Human-level control through deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver et al. · Nature · 2015 · 30K citations
Sushant Jain, Alok Kumar, Subhasree Mandal et al. · ACM SIGCOMM Computer Communication Review · 2013 · 963 citations
SNDlib 1.0—Survivable Network Design Library
S. Orlowski, Roland Wessäly, Michał Pióro et al. · Networks · 2009 · 924 citations
On the Capacitated Controller Placement Problem in Software Defined Networks
Guang Yao, Jun Bi, Yuliang Li et al. · IEEE Communications Letters · 2014 · 359 citations