1999 · 63 citations · 10 references
EngineeringDecision SciencesMathematicsMarkov Decision ProcessesOptimizationStochastic ProcessesPower ManagementPower OptimizationSemi-markov ProcessesStochastic ControlStochastic OptimizationStochastic ProgrammingContinuous-time Markov ProcessesDiscrete-time Markov ChainsDiscrete-time Markov ProcessesOptimal DispatchPolicy OptimizationPower System OptimizationSemi-markov Decision ProcessesStochastic Energy Management
The policy optimization problem for dynamic power management has received considerable attention in the recent past. We formulate policy optimization as a constrained optimization problem on continuous-time SemiMarkov decision processes (SMDP). SMDPs generalize the stochastic optimization approach based on discrete-time Markov decision processes (DTMDP) presented in the earlier work by relaxing two limiting assumptions. In SMDPs, decisions are made at each event occurrence instead of at each discrete time interval as in DTMDP, thus saving power and giving higher performance. In addition, SMDPs can have general inter-state transition time distributions, allowing for greater generality and accuracy in modeling reallife systems where transition times between power states are not geometrically distributed. 1 Introduction Dynamic power management is a widely-employed lowpower design technique. Dynamic power management efficiently exploits system resources by controlling their mode of oper...
10
Mani Srivastava, Anantha P. Chandrakasan, R.W. Brodersen · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · 1996 · 426 citations
Adaptive Disk Spin-Down Policies for Mobile Computers.
Fred Douglis, P. Krishnan · 1995 · 336 citations
Richard Golding, Peter Bösch, Carl Staelin et al. · 1995 · 239 citations