Nope, forts can stay up without combat units and only agents in.

And correct, one merchant per town with market, and I think Banks as well.