The WORLD SIMULATOR

The WORLD SIMULATOR has a number of responsibilities:

• Tracking the MAP of the environment, including objects, terrain types, and obstacles.
• Tracking the LOCATION and value of REWARDs.
• Tracking the LOCATION of the AGENT (i.e., the STATE of the system).
• Responding to AGENT ACTIONs by updating the current STATE (AGENT LOCATION) and returning a REWARD to the AGENT.
• Maintaining the locations of START and GOAL STATEs.
• Detecting when the AGENT has reached a GOAL STATE.