I use garbage units for garrison duty only in emergency - for example if you have an imminent rebellion and you can't pull in reinforcements from anywhere. I believe that you will use these garrison units some day, so there is no need to train those who are likely to fail you in a future battle.