It actually is possible that Milan will fight you for it. In both my England campaigns they are expanding north to Metz and they just captured Paris in my last campaign.

I guess that if they're close they can be a threat.