Fatigue impact is too low compared to MTW running and fighting. Going uphill is very severe with infantry, though. Desert makes no effect in heavy armoured units. Troops with plate mail in summer+desert keep fresh for ages. Light troops tire faster than heavy units in desert because they are not "hardy". But this is another thread...