By operating in a simulated environment, an architecture is able to avoid dealing with such issues as real-time performance and unreliable sensors. A simulator can factor out uninteresting variables and allow the agent to focus on the critcal issues of a task. Thus, the agent can be used as a testbed for higher-level cognitive functions such as planning and learning without real-world implementation issues getting in the way.
Operating in a simulated environment also offers the advantage that the agent may be exposed to a variety of different tasks and surroundings without an inordinate amount of development time. Thus, the same architecture can be applied to tasks involving space exploration and undersea diving without the necessity of developing the necessary hardware to transport the agent to either location.
Below are listed several architectures that make use of simulated environments.