If the Geishas become a real problem, you may have to isolate the Daimyo in a back water province and demolish the port and ports in several adjoining provinces to stop her getting close, then send your ninjas against her. I remember having to do this once because she was targeting my heirless Daimyo...