they why don't you just split your forces (after all, it's only 200 guys over there) and invade both his castel and his attacking province at the same time?

easy.