SIAM Journal on Control and Optimization, Vol.41, No.3, 723-739, 2002
Zero-sum semi-Markov games
This paper deals with Borel state and action spaces zero-sum semi-Markov games under the expected long run average payo criterion. The transition probabilities are assumed to satisfy some generalized geometric ergodicity conditions. The main result states that the optimality equation has a solution, which is approximated by the solutions of some epsilon-perturbed semi-Markov games. As a corollary, the existence of value and average optimal strategies for the players is established.
Keywords:semi-Markov games;Borel state space;long run expected average payoff criterion;Bellman equation