Yes, not removing the army makes a difference: because even if your faction is listed in the file as owning the city, the existing enemy army captures it immediately when the game loads.

Also, make sure that the units you place in the new army (which you put at the end of the armies list for the faction receiving the province) are buildable by that faction, otherwise you might have some problems.