IEEE Journal on Selected Areas in Communications · 2008 · 15 citations · 60 references
ComputingComputer EngineeringComputer NetworksMarkov Decision ProcessesOptimizationCommunication NetworksNetwork OptimizationNetwork Performance AnalysisNetwork SwitchingCircuit Switched NetworksCost Function ModelingHeuristic ApproachMarkov Decision ModelsMetro Optical NetworksReconfigurationReconfiguration Policies
Increasing demand for bandwidth and proliferation of packet based traffic represent a challenge for today's metro networks, which have been traditionally designed to carry circuit- switched connections. The problem is further complicated by the constraints of cost efficiency and traffic adaptability, imposed by the limited customer base in the metro area. Recently, several architectures have been proposed for future metro access networks. Nearly all of these solutions support dynamic reconfigurability, however reconfiguration policies have not been fully explored yet. In this paper, reconfiguration policies for IP/WDM metro access networks with switching delays are considered, where dynamic reconfiguration corresponds to dynamic allocation of wavelengths to access nodes. Exact formulation of the dynamic wavelength allocation (DWA) problem is developed as a Markov Decision Process (MDP) and a new cost function is proposed to attain both throughput efficiency and fairness. For larger problems, a heuristic approach based on first passage probabilities is developed and shown to yield nearly optimum performance through simulations.
60
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations
Reinforcement Learning: An Introduction
Jeffrey D. Johnson, Jinghong Li, Zengshi Chen · Neurocomputing · 2000 · 8.7K citations
Congestion avoidance and control
Van Jacobson · ACM SIGCOMM Computer Communication Review · 1995 · 5.3K citations