It's because you still have units around there. Move those units away from the region before giving the province and you won't have any problems.