The problem with Inns is that mercs are usually one shot units. After one or two battles all you have is a remnant. Especially with Cav.

Still, such is life. Currently my empire is hemoraging around 6,000 florins a year. First thing I did was ditch the merc cav.