The most effective way to handle partial observability is for the agent to keep track of the part of the world it can’t see now.

Updating the internal state information as time goes by requires two kinds of knowledge to be encoded in the agent program.

First, we need some …