Actually you can put more 2 or 3 ladders on a wall section, but only if the same unit is carrying them all.

It makes them climb much faster.