Just turn off the fog of war and you can peruse the whole map to your heart's content.