In my game they step out of the city and then march to the rally points, very handy when I'm trying to get my cities to a huge size, I just send plenty of peasants to the city I'm trying to upgrade and disband them there