If you're near some mountain range you can get hit with the winter penalty, methinks. Happens in the North African mountains at least IIRC.

After all, wherever you are once the geography starts working in the vertical the climate turns right out arctic pretty fast...