Applied Mathematics and Optimization, Vol.83, No.3, 1311-1352, 2021
A Framework for the Dynamic Programming Principle and Martingale-Generated Control Correspondences
We construct an abstract framework in which the dynamic programming principle (DPP) can be readily proven. It encompasses a broad range of common stochastic control problems in the weak formulation, and deals with problems in the "martingale formulation" with particular ease. We give two illustrations; first, we establish the DPP for general controlled diffusions and show that their value functions are viscosity solutions of the associated Hamilton-Jacobi-Bellman equations under minimal conditions. After that, we show how to treat singular control on the example of the classical monotone-follower problem.
Keywords:Dynamic programming principle;Optimal stochastic control;Control correspondences;Martingale problem;Singular control