The heirs arrive historically, but I believe the heirs of your heirs are random. Kill of your daimyo and your remaining heir should start to have sons. This late in the game watch out for geisha...

And yes a little faster could help the devs put things in the game to end it even though there is no time limit really.