ACM SIGMETRICS Performance Evaluation Review · 2012 · 10 citations · 29 references
BusinessSystems EngineeringMarkov Decision ProcessesQueuing TheorySchedulingInfinite-horizon Markov Decision ProcessesResource BrokeringStochastic Service SystemsAdmission ControlAdmission Control PoliciesContinuous-time ModelsContinuous-time OptimizationQos ManagementQos-aware ProvisioningQuality Of Service Optimization
In the service computing paradigm, a service broker can build new applications by composing network-accessible services offered by loosely coupled independent providers. In this paper, we address the problem of providing a service broker, which offers to prospective users a composite service with a range of different Quality of Service (QoS) classes, with a forward-looking admission control policy based on Markov Decision Processes (MDP). This mechanism allows the broker to decide whether to accept or reject a new potential user in such a way to maximize its gain while guaranteeing non-functional QoS requirements to its already admitted users. We model the broker using a continuous-time MDP and consider various techniques suitable to solve both infinite-horizon and finitehorizon MDPs. To assess the effectiveness of the MDP-based admission control for the service broker, we present simulation results where we compare the optimal decisions obtained by the analytical solution of the MDP with other admission control policies. To deal with large problem instances, we also propose a heuristic policy for the MDP solution.
29
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations
Web Services Business Process Execution Language Version 2.0
Charlton Barreto, Vaughn Bullard, Thomas Erl et al. · 2007 · 2.8K citations
Software rejuvenation: analysis, module and applications
Yennun Huang, Chandra M. R. Kintala, N. Kolettis et al. · 2002 · 924 citations