Abstract
We consider the problem of optimizing over time hundreds or thousands of discrete entities that may be characterized by relatively complex attributes, in the presence of different forms of uncertainty. Such problems arise in a range of operational settings such as transportation and logistics, where the entities may be aircraft, locomotives, containers, or people. These problems can be formulated using dynamic programming but encounter the widely cited "curse of dimensionality." Even deterministic formulations of these problems can produce math programs with millions of rows, far beyond anything being solved today. This paper shows how we can combine concepts from artificial intelligence and operations research to produce practical solution methods that scale to industrial-strength problems. Throughout, we emphasize concepts, techniques, and notation from artificial intelligence and operations research to show how these fields can be brought together for complex stochastic, dynamic problems.
Original language | English (US) |
---|---|
Pages (from-to) | 2-17 |
Number of pages | 16 |
Journal | INFORMS Journal on Computing |
Volume | 22 |
Issue number | 1 |
DOIs | |
State | Published - Dec 2010 |
All Science Journal Classification (ASJC) codes
- Software
- Information Systems
- Computer Science Applications
- Management Science and Operations Research
Keywords
- Approximate dynamic programming
- Curse of dimensionality
- Machine learning
- Reinforcement learning
- Stochastic optimization