Bellman’s principle of optimality: An optimal policy (set of decisions) has the property that whatever the initial state and decisions are, the remaining decisions must constitute and optimal policy with regard to the state resulting from the first decision.

Mathematically, this can be written as:

$f_N(x) = max. [r(d_n) +f_N-1{T(x …