Think it could well be linked to the concpt of "the best time to knock it down".
Perhaps however the AI isnt taking into account the other factors such as faction/general religion and therefore, there isnt ever a good time to knock it down.