TY - JOUR
T1 - Monotonicity in multidimensional Markov decision processes for the batch dispatch problem
AU - Papadaki, Katerina
AU - Powell, Warren Buckler
N1 - Funding Information:
We would like to thank Diego Klabjan for highlighting the inconsistency of using the scalar results from [4] in a multidimensional setting. The second author was supported in part by Grant AFOSR-FA9550-05-1-0121 from the Air Force Office of Scientific Research and NSF Grant CMS-0324380.
PY - 2007/3
Y1 - 2007/3
N2 - Structural properties of stochastic dynamic programs are essential to understanding the nature of the solutions and in deriving appropriate approximation techniques. We concentrate on a class of multidimensional Markov decision processes and derive sufficient conditions for the monotonicity of the value functions. We illustrate our result in the case of the multiproduct batch dispatch (MBD) problem.
AB - Structural properties of stochastic dynamic programs are essential to understanding the nature of the solutions and in deriving appropriate approximation techniques. We concentrate on a class of multidimensional Markov decision processes and derive sufficient conditions for the monotonicity of the value functions. We illustrate our result in the case of the multiproduct batch dispatch (MBD) problem.
KW - Markov decision processes
KW - Monotone value functions
UR - http://www.scopus.com/inward/record.url?scp=33847083980&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=33847083980&partnerID=8YFLogxK
U2 - 10.1016/j.orl.2006.03.013
DO - 10.1016/j.orl.2006.03.013
M3 - Article
AN - SCOPUS:33847083980
SN - 0167-6377
VL - 35
SP - 267
EP - 272
JO - Operations Research Letters
JF - Operations Research Letters
IS - 2
ER -