Yea. You have pretty much failed.. If you are playing slow, you can't only "look to yourself", you need always have one eye on your enemies. If one faction get to large, send a expedition force to weaken them. Raid, burn and slaughter. It is important to play you enemies against each other. To make buffer states, as you have already done, is one way.
Better luck on your next campaign!
Bookmarks