A few enslavements of Arretium, Roma, and Capua will restore whatever population deficit you had faced. I like to keep the Romans around for a long time as a means of training my Aedui generals and giving them the Romaneitas and Romaneitha traits.