A tuple – (S,s1,A,P,R) S – finite set of states. s1 – initial state. A – finite set of actions. P – Given a state s1 and action a, what is the probability of ending up at a particular state s2? This information is provided by P. This is called a State transition probability matrix.…