Yeah this is something I've always been confused about too.
I remember learning that lunch was in the afternoon and dinner was in the night. Then I got my hands on a bunch of Enid Blyton books, and it got confusing.