In response to the walls being knocked down from just arrows, perhaps it was your balista towers shooting at your own walls, and eventually destroying them. It's happened to me before, but its pretty unlikely that they destroy the walls on their own.