Verdad! I don't even believe a merchant can enter an enemy (or ally, for that matter) fort/settlement. To the best of my knowledge, only spies (and assassins?) can enter an enemy settlement.