This page contains links to download various POMDP parameter files that have appeared in the literature. A description of the format of these files can be found on the file specification page, with the corrresponding more formal file syntax.
ejs.tar.gz - Examples from Ed Sondik's
1971 thesis and OR papers;
cheng-examples.tar.gz - Hsien-Te
Cheng's 1988 thesis examples;
tiger.aaai.POMDP - Cassandra, Littman
and Kaelbling's AAAI-94 Tiger problem;
1d.POMDP - Littman's 1D maze;
4x3.95.POMDP - Russell and Norvig's 4x3
maze;
cheese.95.POMDP - McCallum's cheese
maze;
shuttle.95.POMDP - Chrisman's shuttle
docking problem;
mini-hall2.POMDP,
hallway.POMDP,
hallway2.POMDP,
tiger-grid.POMDP - Navigation
problems from Littman, Cassandra and Kaelbling's ML-95 paper;
parr95.95.POMDP - This example is from
Parr and Russell's paper on the SPOVA RL algorithm from IJCAI'95.
paint.95.POMDP - Part painting problem
inspired by the Buridan planner paper example;
4x4.95.POMDP - Cassandra, Littman and
Kaelibling's AAAI-94 4x4 grid;
network.POMDP - Littman's network
problem;
bridge-repair.POMDP - A bridge
inspection and repair problem of Hugh Ellis, et al.
cit.POMDP,
mit.POMDP,
sunysb.POMDP,
pentagon.POMDP,
fourth.POMDP -
Hallway navigation problems from Cassandra, Kurien and Kaelbling's
IROS-96 paper;
milos-aaai97.POMDP - 20 state maze
from Milos Hauskrecht's AAAI-97 paper.
1d.noisy.POMDP - Noisy transition version of
Littman's 1D maze;
concert.POMDP - Michael Littman's
concert problem;
tiger.aaai.POMDP - Version of AAAI-94
Tiger problem with 0.95 discount factor (instead of 0.75);
stand-tiger.95.POMDP -
Slight extension of the tiger problem;
line4-2goals.POMDP -
a line of uniquely appearing states with a goal at both ends;
4x5x2.95.POMDP - A 2 floor 4x5
navigation problem;
bulkhead.A.POMDP - Non-destructive
testing problem of a titanium aircraft engine bulkhead;
marking.POMDP,
marking2.POMDP -
Two versions of a problem proposed by Tom Dean about a robot that can
mark its environment.
mcc-example1.POMDP,
mcc-example2.POMDP,
web-ad.POMDP,
web-mall.POMDP -
Variations of an example of choosing advertisements for web pages
based on user actions (made for MCC job talk);
saci-s12-a6-z5.95.POMDP -
Aircraft identification problem with 12 states, 6 actions and 5
observations;
saci-s100-a10-z31.POMDP -
Aircraft identification problem with 100 states, 10 actions and 31
observations;
query.s2.POMDP,
query.s3.POMDP,
query.s4.POMDP - Problems for
distributed querying decisions with 2, 3 and 4 resources
respectively.
learning.c2.POMDP,
learning.c3.POMDP,
learning.c4.POMDP - Problem of
teaching policies for trying to learn 2, 3 and 4 concepts
respectively.
I promised in my thesis to make sure the examples I used would be available. Here are all the specific examples I used in my thesis, which is a subset of the list of examples above.
toy-pomdp-probs.tar.gz - Suite
of 9 small problems;
hallway.POMDP - Hallway (57 state
navigation problem);
hallway2.POMDP - Hallway-2 (89
state navigation problem);
Larger Robot Navigation Problems
cit.POMDP - A coarse model of the
fourth floor of the CIT building, Brown University;
mit.POMDP - Simplified model of the
8th floor of MIT's Computer Science building;
sunysb.POMDP - First floor of
Computer Science building, SUNY at Stony Brook;
pentagon.POMDP - Inspired by
the Pentagon building with an inner and outer hallway;
fourth.POMDP - A detailed
portion of the four floor, CIT building, Brown University.
iff.POMDP - Approaching aircraft
identification problem;
machine.POMDP - Model of
maintenance for a machine with 4 independently failing components;
baseball.POMDP - Simple model of
1 inning of a baseball game;
aloha.10.POMDP - Slotted Aloha
model with a limit of 10 backlogged messages;
aloha.30.POMDP - Slotted Aloha
model with a limit of 30 backlogged messages.
Last updated: 01/31/99