Yes, fire arrows are the trick when the enemy is essentially stalled while breaking down gates. They hit your gate guards with some nice morale penalties that make it worth your time.