I always secure passes and fords on my borders with castles, and set up watchtowers everywhere so I can see everything inside my empire and beyond!

The AI is so dumb, often it builds towers right next to their cities.