I don't have any problems with the towers. If you are assaulting wooden walls, it should be very easy to stay away from their range. If your units have proper armor, stone wall defenses won't cause too many casualties either (just make sure they never turn their backs to the towers).