% MDP.s(F,T) - matrix of true states - for each hidden factor % MDP.o(G,T) - matrix of outcomes - for each outcome modality % or .O{G}(O,T) - likelihood matrix - for each outcome modality % MDP.u(F,T ...

How do you plan efficiently if the results of your actions are uncertain? There is some remarkably good news, and some some significant computational hardship. We begin by discussing Markov Systems ...

% MDP.O(O,T) - a sparse matrix encoding outcomes at time 1,...,T % MDP.S(N,T) - a sparse matrix encoding states at time 1,...,T % MDP.U(M,T) - a sparse matrix encoding action at time 1,...,T % MDP.W(1 ...