I've noticed that too, other allied factions breaking the alliance and attacking you seems to have a negative effect on YOUR reputation...