An ally will only fight with you if you both attack the same province or are relieving an ally under seige.

If you both attack the same province whichever nation has the largest force (prior ro the battle) will get control of the province. If you are relieving a seige all you get is a thank you.