One way in which this problem is overcome is by incorporating some form of focusing mechanism, whereby the agent determines what sort of information it needs to attack the current problem. It looks for and processes all relevant information it can, but (more or less) ignores other extraneous data. By focusing all of its processes only on the problem at hand, the combinatorial explosion of information from the world can be sidestepped.
The following list of architectures represents different implementations of focusing mechanisms that differ both in approach and extent.