Fight fire with fire. Build a Keep. Then all you need is a Royal Court to make Royal Knights or a Spearmaker's Workshop and a Horsebreeder for Mounted Sergeants. My early HRE stacks consist of 5 RK's/5 Spearmen (or FS)/5 FMAA and a general.