As QM pointed out above, slashing BFLs (basic farming levels) has changed the dynamic here quite a bit. In v.81 you will find that population increase buildings aren't something to be avoided like the plague.