I think that adding milk to Earl Grey can ease the strong bergamot taste on the palate, and I usually add just a little to complement the flavour in such a manner; I forego the milk if I want the whole pick-me-up element though, and almost always take Lady Grey without milk. :P
I also feel that sugar/sweetener is a definite no-no with speciality blends like that, they just seem to detract from the overall taste too.
Bookmarks