Can't attack Neutral faction all of a sudden

[MPMFV]

I tried that too. They can attack me, but I can't attack them, must be one of those rare glitches.