Operations Research · 1985 · 18 citations · 12 references
BusinessDecision SciencesIndustrial EngineeringMarkov Decision ProcessesOptimizationQueuing TheoryQueueing AnalysisQueueing NetworksQueueing ProcessesQueueing SystemsQueueing TheoryStochastic ControlContinuous-time Markov ChainsContinuous-time Markov ProcessesFinite-state ProcessesOptimal PoliciesQueueing ControlQueueing Control PoliciesQueueing ModelsSwitching Cost Analysis
We consider the problem of determining optimal operating policies for an M/M/S queueing system. The system state (x 1 , x 2 ) is defined by x 1 the number of customers in the system, and x 2 the number of active service channels. The cost structure includes customer holding and service channel operating costs as well as a linear switching cost. We use a continuous-time Markov decision process formulation to obtain an optimal control policy of the control limit form, and present an algorithm for the finite state problem. Finite-transition and infinite-transition with discounting are considered.
12