Cavalry is too useful to eschew altogether although I agree that you don’t need much. Yari armed infantry is so common that any cavalry must be used with caution.

I find that light cav is fine for whatever needs doing by horsemen. They can catch and kill command units and routers alike and are cheap compared to other cavalry. I do raise other mounted unit types but just for variety and fun. Horse archers can be a hoot if you don’t mind micromanaging them.