Have you checked for enemy spies? They are known to cause unrest in your settlements.