20 units of peasants will give you the bonus for 20,000 residents. Whereas the town watch will only keep full public order for up to 13,333 residents. I garrison with a few few professionals and after that its peasants to keep public order. Where a town hits 20'000 residents I have 20 peasants inside and keep a profeesional army nearby