Alwasys destroy the previous governments before you build your own government buildings in a new province. It's a code limitation - we can't totally destroy the old buildings like we would like. But you need to put your own govt buildings in - not use the old ones from the other faction.