As said above the those siege towers do not hold much ammunition. I keep wall units if I am defending the wall at a distance. Only fire arrow archers are allowed near in the hope of setting them alight.

BTW

I have noticed how with epic walls the exact damage is registers on siege towers, otherwise it seems like chance to take them down.