You click on the top of the wall. Then they'll go through the tower to get there. Sometimes the units seem to mess around a bit before they go through the door though, so give them time.