Introduction - If you have any usage issues, please Google them yourself
The MDP toolbox proposes functions related to the resolution of discrete-time Markov Decision Process : finite horizon, value iteration, policy iteration, linear programming algorithms with some variants.
The functions (m-functions) were developped with MATLAB v6.0 (one of the functions requires the Mathworks Optimization Toolbox) by the decision team of the Biometry and Artificial Intelligence Unit of INRA Toulouse (France).
The version 2.0 (February 2005) handles sparse matrices and contains an example
Packet : 29782173mdptoolbox.zip filelist
MDPtoolbox/
MDPtoolbox/documentation/
MDPtoolbox/documentation/arrow.gif
MDPtoolbox/documentation/DOCUMENTATION.html
MDPtoolbox/documentation/index_alphabetic.html
MDPtoolbox/documentation/index_category.html
MDPtoolbox/documentation/logo_inra.gif
MDPtoolbox/documentation/logo_mia.gif
MDPtoolbox/documentation/mdp_bellman_operator.html
MDPtoolbox/documentation/mdp_bellman_operator_policy.html
MDPtoolbox/documentation/mdp_check.html
MDPtoolbox/documentation/mdp_check_square_stochastic.html
MDPtoolbox/documentation/mdp_computePR.html
MDPtoolbox/documentation/mdp_eval_policy.html
MDPtoolbox/documentation/mdp_finite_horizon.html
MDPtoolbox/documentation/mdp_LP.html
MDPtoolbox/documentation/mdp_policy_iteration.html
MDPtoolbox/documentation/mdp_policy_iteration_modified.html
MDPtoolbox/documentation/mdp_rand.html
MDPtoolbox/documentation/mdp_relative_value_iteration.html
MDPtoolbox/documentation/mdp_span.html
MDPtoolbox/documentation/mdp_value_iteration.html
MDPtoolbox/documentation/mdp_value_iterationGS.html
MDPtoolbox/documentation/mdp_value_iteration_bound_iter.html
MDPtoolbox/documentation/mdp_verbose_silent.html
MDPtoolbox/examples/
MDPtoolbox/examples/race/
MDPtoolbox/examples/race/action_to_acceleration.m
MDPtoolbox/examples/race/compute_transitions.m
MDPtoolbox/examples/race/convert_values_to_state.m
MDPtoolbox/examples/race/data/
MDPtoolbox/examples/race/data/100x100/
MDPtoolbox/examples/race/data/100x100/100_100_track.txt
MDPtoolbox/examples/race/data/10x10/
MDPtoolbox/examples/race/data/10x10/10_10_track.txt
MDPtoolbox/examples/race/data/10x10/trans_matrix_-1_-1.dat
MDPtoolbox/examples/race/data/10x10/trans_matrix_-1_0.dat
MDPtoolbox/examples/race/data/10x10/trans_matrix_-1_1.dat
MDPtoolbox/examples/race/data/10x10/trans_matrix_0_-1.dat
MDPtoolbox/examples/race/data/10x10/trans_matrix_0_0.dat
MDPtoolbox/examples/race/data/10x10/trans_matrix_0_1.dat
MDPtoolbox/examples/race/data/10x10/trans_matrix_1_-1.dat
MDPtoolbox/examples/race/data/10x10/trans_matrix_1_0.dat
MDPtoolbox/examples/race/data/10x10/trans_matrix_1_1.dat
MDPtoolbox/examples/race/data/11x11/
MDPtoolbox/examples/race/data/11x11/11_11_track.txt
MDPtoolbox/examples/race/data/25x25/
MDPtoolbox/examples/race/data/25x25/25_25_track.txt
MDPtoolbox/examples/race/data/25x25/trans_matrix_-1_-1.dat
MDPtoolbox/examples/race/data/25x25/trans_matrix_-1_0.dat
MDPtoolbox/examples/race/data/25x25/trans_matrix_-1_1.dat
MDPtoolbox/examples/race/data/25x25/trans_matrix_0_-1.dat
MDPtoolbox/examples/race/data/25x25/trans_matrix_0_0.dat
MDPtoolbox/examples/race/data/25x25/trans_matrix_0_1.dat
MDPtoolbox/examples/race/data/25x25/trans_matrix_1_-1.dat
MDPtoolbox/examples/race/data/25x25/trans_matrix_1_0.dat
MDPtoolbox/examples/race/data/25x25/trans_matrix_1_1.dat
MDPtoolbox/examples/race/data/4x4/
MDPtoolbox/examples/race/data/4x4/4_4_track.txt
MDPtoolbox/examples/race/data/50x50/
MDPtoolbox/examples/race/data/50x50/50_50_track.txt
MDPtoolbox/examples/race/data/7x7/
MDPtoolbox/examples/race/data/7x7/7_7_track.txt
MDPtoolbox/examples/race/display_race.m
MDPtoolbox/examples/race/documentation/
MDPtoolbox/examples/race/documentation/circuit.ps
MDPtoolbox/examples/race/documentation/circuit2.ps
MDPtoolbox/examples/race/documentation/elig-cumul.eps
MDPtoolbox/examples/race/documentation/elig-replace.eps
MDPtoolbox/examples/race/documentation/french2.sty
MDPtoolbox/examples/race/documentation/race_documentation.pdf
MDPtoolbox/examples/race/documentation/race_documentation.tex
MDPtoolbox/examples/race/documentation/sparse2.ps
MDPtoolbox/examples/race/documentation/successeurs.ps
MDPtoolbox/examples/race/documentation/transfo.ps
MDPtoolbox/examples/race/generate_starting_state.m
MDPtoolbox/examples/race/gen_transition_matrix.m
MDPtoolbox/examples/race/get_values_from_state.m
MDPtoolbox/examples/race/index_computation.m
MDPtoolbox/examples/race/main.m
MDPtoolbox/examples/race/race_end.m
MDPtoolbox/examples/race/read_data.m
MDPtoolbox/examples/race/safe_transition.m
MDPtoolbox/examples/race/simulate_transitions.m
MDPtoolbox/examples/race/trajectory.m
MDPtoolbox/examples/race/transition_matrix.m
MDPtoolbox/mdp_bellman_operator.m
MDPtoolbox/mdp_bellman_operator_policy.m
MDPtoolbox/mdp_check.m
MDPtoolbox/mdp_check_square_stochastic.m
MDPtoolbox/mdp_computePR.m
MDPtoolbox/mdp_eval_policy.m
MDPtoolbox/mdp_finite_horizon.m
MDPtoolbox/mdp_LP.m
MDPtoolbox/mdp_policy_iteration.m
MDPtoolbox/mdp_policy_iteration_modified.m
MDPtoolbox/mdp_rand.m
MDPtoolbox/mdp_relative_value_iteration.m
MDPtoolbox/mdp_silent.m
MDPtoolbox/mdp_span.m
MDPtoolbox/mdp_value_iteration.m
MDPtoolbox/mdp_value_iterationGS.m
MDPtoolbox/mdp_value_iteration_bound_iter.m
MDPtoolbox/mdp_verbose.m
MDPtoolbox/README