Abstract
We study a new algorithm for solving parabolic partial differential equations (PDEs) and backward stochastic differential equations (BSDEs) in high dimension, which is based on an analogy between the BSDE and reinforcement learning with the gradient of the solution playing the role of the policy function, and the loss function given by the error between the prescribed terminal condition and the solution of the BSDE. The policy function is then approximated by a neural network, as is done in deep reinforcement learning. Numerical results using TensorFlow illustrate the efficiency and accuracy of the studied algorithm for several 100-dimensional nonlinear PDEs from physics and finance such as the Allen–Cahn equation, the Hamilton–Jacobi–Bellman equation, and a nonlinear pricing model for financial derivatives.
Original language | English (US) |
---|---|
Pages (from-to) | 349-380 |
Number of pages | 32 |
Journal | Communications in Mathematics and Statistics |
Volume | 5 |
Issue number | 4 |
DOIs | |
State | Published - Dec 1 2017 |
All Science Journal Classification (ASJC) codes
- Statistics and Probability
- Computational Mathematics
- Applied Mathematics
Keywords
- Backward stochastic differential equations
- Control
- Deep learning
- Feynman-Kac
- High dimension
- PDEs