Ismael would refer to the Arabs. Both Jews and Arabs/Muslims (yes I know they're not the same thing) regard themselves as children of Abraham, but the Jews trace their line through Isaac, the Arabs through Ismael. As you go on through the Old Testament, periodically this tension between the 2 people groups flares up.