This page contains links to download various POMDP parameter files that have appeared in the literature. A description of the format of these files can be found on the file specification page, with the corrresponding more formal file syntax.
cheng-examples.tar.gz - Hsien-Te Cheng's 1988 thesis examples;
tiger.aaai.POMDP - Cassandra, Littman and Kaelbling's AAAI-94 Tiger problem;
1d.POMDP - Littman's 1D maze;
4x3.95.POMDP - Russell and Norvig's 4x3 maze;
cheese.95.POMDP - McCallum's cheese maze;
shuttle.95.POMDP - Chrisman's shuttle docking problem;
mini-hall2.POMDP, hallway.POMDP, hallway2.POMDP, tiger-grid.POMDP - Navigation problems from Littman, Cassandra and Kaelbling's ML-95 paper;
parr95.95.POMDP - This example is from Parr and Russell's paper on the SPOVA RL algorithm from IJCAI'95.
paint.95.POMDP - Part painting problem inspired by the Buridan planner paper example;
4x4.95.POMDP - Cassandra, Littman and Kaelibling's AAAI-94 4x4 grid;
network.POMDP - Littman's network problem;
bridge-repair.POMDP - A bridge inspection and repair problem of Hugh Ellis, et al.
cit.POMDP, mit.POMDP, sunysb.POMDP, pentagon.POMDP, fourth.POMDP - Hallway navigation problems from Cassandra, Kurien and Kaelbling's IROS-96 paper;
milos-aaai97.POMDP - 20 state maze from Milos Hauskrecht's AAAI-97 paper.
concert.POMDP - Michael Littman's concert problem;
tiger.aaai.POMDP - Version of AAAI-94 Tiger problem with 0.95 discount factor (instead of 0.75);
stand-tiger.95.POMDP - Slight extension of the tiger problem;
line4-2goals.POMDP - a line of uniquely appearing states with a goal at both ends;
4x5x2.95.POMDP - A 2 floor 4x5 navigation problem;
bulkhead.A.POMDP - Non-destructive testing problem of a titanium aircraft engine bulkhead;
marking.POMDP, marking2.POMDP - Two versions of a problem proposed by Tom Dean about a robot that can mark its environment.
mcc-example1.POMDP, mcc-example2.POMDP, web-ad.POMDP, web-mall.POMDP - Variations of an example of choosing advertisements for web pages based on user actions (made for MCC job talk);
saci-s12-a6-z5.95.POMDP - Aircraft identification problem with 12 states, 6 actions and 5 observations;
saci-s100-a10-z31.POMDP - Aircraft identification problem with 100 states, 10 actions and 31 observations;
query.s2.POMDP, query.s3.POMDP, query.s4.POMDP - Problems for distributed querying decisions with 2, 3 and 4 resources respectively.
learning.c2.POMDP, learning.c3.POMDP, learning.c4.POMDP - Problem of teaching policies for trying to learn 2, 3 and 4 concepts respectively.
I promised in my thesis to make sure the examples I used would be available. Here are all the specific examples I used in my thesis, which is a subset of the list of examples above.
hallway.POMDP - Hallway (57 state navigation problem);
hallway2.POMDP - Hallway-2 (89 state navigation problem);
Larger Robot Navigation Problems
mit.POMDP - Simplified model of the 8th floor of MIT's Computer Science building;
sunysb.POMDP - First floor of Computer Science building, SUNY at Stony Brook;
pentagon.POMDP - Inspired by the Pentagon building with an inner and outer hallway;
fourth.POMDP - A detailed portion of the four floor, CIT building, Brown University.
iff.POMDP - Approaching aircraft identification problem;
machine.POMDP - Model of maintenance for a machine with 4 independently failing components;
baseball.POMDP - Simple model of 1 inning of a baseball game;
aloha.10.POMDP - Slotted Aloha model with a limit of 10 backlogged messages;
aloha.30.POMDP - Slotted Aloha model with a limit of 30 backlogged messages.
Last updated: 01/31/99