I wish there was. It's amazing the amount of bowfire one man in a castle can do, too.

Still, if you don't want to assault, you could try assassinating the annoying bugger