Adding agents to the armies helps; but the main factor should be the authority of your faction leader. Altough you are supposed not to have everyone loyal to you. In those times there was a lot of powers that generals held, and with most factions had a certain degree of independence.
Bookmarks