I found I can rename a city or castle by simply clicking on its name in the city build panel. Once I conquered Tunis while playing Spain and changed the name to Carthago.

Just a heads-up to all who may be interested.