This page is devoted to things related to work done at Brown University's Computer Science Department on partially observable Markov decision processes (POMDPs). Most of this work stems from work done by Michael Littman, Leslie Kaelbling. and myself from the Spring of 1994 to the Fall of 1997.
Here are the main sub-topics that I have pages on:
POMDP tutorial - I made a
simplified POMDP tutorial a while back. It is still in a
somewhat crude form, but people tell me it has served a useful
purpose.
POMDP Papers - For research papers
done at Brown on POMDPs, see this page.
POMDP examples - From other
literature sources and our own work, we have accumulated a bunch of
POMDP examples.
POMDP code - In addition to the
format and examples, I have C-code for solving POMDPs that is
available.
POMDP people - Just a list of people I
interacted with concerning POMDPs.
Last updated: 01/31/99