Taking the castle route or the city route appears to be a symbol for focusing a province on either military or financial development.
No, I read somewhere that castles would give you an advantage early on (providing feudal troops) but later on cities provide more powerfull troops (gunpowder units, militia?).