I'm pretty sure that only means they will engage in combat against that faction within the next 15 turns, not that they will be at war with them for the next 15. I've promised military assistance to my allies a few times, and it drops off the diplomacy screen as soon as one combat is done, or even a blockade of a port. It seems to even work if they attack you.