Tutorial on Stochastic Optimization in Energy - Part II: An Energy Storage Illustration

Warren Buckler Powell, Stephan Meisel

Research output: Contribution to journalArticlepeer-review

77 Scopus citations


In Part I of this tutorial, we provided a canonical modeling framework for sequential, stochastic optimization (control) problems. A major feature of this framework is a clear separation of the process of modeling a problem, versus the design of policies to solve the problem. In Part II, we provide additional discussion behind some of the more subtle concepts such as the construction of a state variable. We illustrate the modeling process using an energy storage problem. We then create five variations of this problem designed to bring out the features of the different policies. The first four of these problems demonstrate that each of the four classes of policies is best for particular problem characteristics. The fifth policy is a hybrid that illustrates the ability to combine the strengths of multiple policy classes.

Original languageEnglish (US)
Article number7100937
Pages (from-to)1468-1475
Number of pages8
JournalIEEE Transactions on Power Systems
Issue number2
StatePublished - Mar 2016

All Science Journal Classification (ASJC) codes

  • Energy Engineering and Power Technology
  • Electrical and Electronic Engineering


  • Approximate dynamic programming
  • dynamic programming
  • energy storage
  • energy systems
  • optimal control
  • reinforcement learning
  • robust optimization
  • stochastic optimization
  • stochastic programming


Dive into the research topics of 'Tutorial on Stochastic Optimization in Energy - Part II: An Energy Storage Illustration'. Together they form a unique fingerprint.

Cite this