Alicia Peregrin WolfeThe problem of finding hidden state in a POMDP and the problem of finding abstractions for MDPs are closely related. This work analyzes the connection between existing Predictive State Representation methods and homomorphic reductions of Markov Processes. We formally define a POMDP homomorphism, then extend PSR reduction methods to find POMDP homomorphisms when the original POMDP is known. The resulting methods find more compact abstract models in situations where different observations have the same meaning. Attached Files: |
Posters >
