Something you might want to try if you're playing as Rome is get the Augustan reforms to trigger, since you can train Imperial Cohorts and Imperial cavalry almost everywhere. This may not be quite the solution you had in mind, but it does make replacing them very easy.