So far I've only used siege weapons in the tutorial but there I was unable to destroy the walls of castles. I could damage them 100% but that had no clear effect.
Is this a bug or are you unable to breach walls in Shogun2?