Even on medium they are really useful, on harder difficulties you can't win without them. Though I will admit that diplomats are useless, after all if the AI doesn't except peace treaties whats the point of being able to offer them, and spy's are better at recon. Also before any siege I send in one or two or even spies to make sure that the gate is open (much easier and better than building siege equipent and wreaking the city).