You click on the wall itsellf. When you have a unit selected, mouse over the wall. When you see the mouse cursor turn into a gray brick tower click it. If you have more than 1 unit selected it wo'nt work. Also 1 ladder per wall section.