Markov processes form a fundamental class of stochastic models in which the evolution of a system is delineated by the memoryless property. In such processes, the future state depends solely on the ...

This paper describes sufficient conditions for the existence of optimal policies for partially observable Markov decision processes (POMDPs) with Borel state, observation, and action sets, when the ...

It is shown that sequences of generalized semi-Markov processes converge in the sense of weak convergence of random functions if associated sequences of defining elements (initial distributions, ...