I use forts all the time...I never get besieged...because i want to protect the landscape of the region ,keeping it clean and not black...all my troops are within the forts and in the towns i use 2-3 units garrison only