Spies - lots of them. Once the defenders are besieged use spies to "open the castle gates" - you will get the province and all it's goodies intact. Problem is that the chances of success are pretty bad, and they only get good just before the castle falls. Use several spies at once, and just hope for the best.