SIAM Journal on Applied Mathematics · 1966 · 89 citations · 14 references
EngineeringEconomicsIndustrial EngineeringMarkov Decision ProcessesOptimizationInteger ProgrammingLinear ProgrammingMarkov ChainsMarkov ProcessesRenewal ProcessesRenewal TheoryLinear Programming OptimizationLinear Programming RelaxationsMarkov Renewal ProcessesMultichain Markov Decision ProcessesRenewal Program Optimization
Markov renewal programming is treated by linear fractional programming. Particular attention is given to the resolution of tied policies that minimize expected cost per unit time. The multichain case is handled by a decomposition approach.
14
David Blackwell · The Annals of Mathematical Statistics · 1962 · 834 citations
Business, Economics, Mathematics +13
Contraction Mappings in the Theory Underlying Dynamic Programming
Eric V. Denardo · SIAM Review · 1967 · 466 citations
On Sequential Decisions and Markov Chains
Cyrus Derman · Management Science · 1962 · 258 citations