It's like I said earlier. Once you move your army into another persons settlement it is free game. So make sure beforehand that the owner of that city is friendly to you before moving into it. It's really the same thing as the Frankfurt situation. Once again it is potentially dangerous to enter another nobles settlement. The only way to make sure you keep your army is by staying out of settlements!