Use archers on the walls and get them to set their arrows alight and rain fire upon the sap point. If you don't have archers deploy your infantry by the side gate (the one that the enemy isn't attacking. Send them out round the side and destroy the sap point.

Note that it MUST be infantry. Cavalry don't seem to do any damage to sap points.