Estimation of Hidden Markov Models for Partially Observed Risk Sensitive Control Problems

B.A. Frankpitt and J.S. Baras

Kybernetika, Vol 34, No. 6, pp 739-746, 1998.

Abstract

This paper provides a summary of our recent work on the problem of combined estimation and control of systems described by finite state, hidden Markov models. We establish the stochastic framework for the problem, formulate a separated control policy with risk-sensitive cost functional, describe an estimation scheme for the parameters of the hidden Markov model that describes the plant and finally indicate how the combined estimation and control problem can be reformulated in a framework that permits an application of stochastic approximation techniques to the proof of asymptotic convergence of the estimator.