Of course you can upgrade them, that is not hard to do. Just send them to a city where there are upgrades available to their type and put them into the Retraining qeue.
I always upgrade my mercs as they might lag behind if you don't.