Sure the settlement wasn't bribed from you? Plus there is a bug that when you bribe a settlement sometimes the general will step outside for no reason at all.