Playing as Saba, which has mostly javelin users, I think that indeed they don't do a lot of damage. Example: Fighting the Seleucids (treacherous scum, they betrayed me while I was trying to help them against the monstrous Ptolemies), I had three units of King's elite throwing a rain of javellin against a phalanx and they killed 4-5 men.