Do you also notice that you lose control of your watch tower as well while the enemy is camped there...