It works by just moving your spy into the province. Only your highest valour spy in the province counts, and I believe the effect is 40% + 20% per star, so you should have seen an 80% drop. Buildings and tax policy counter this of course, and it's possible the AI put one of his own spies in the province to counter the effect (counterspy uses the same formula to raise the happiness).