I always try to get at least stone walls on all of my sttlements, because then i can just put some archers at the top and they will be able to fire away at the enemy! Its an incredible usefulthing to have when you're being besieged, especially if the enemy has no missile weaponry.