You want to set up a regular tribute from you to the Faction you're allied with. Try something small 200mnai a turn for 20turns or something else you can easily keep up. The AI will be more hesitant in attacking you since you're giving them money.