From the little I have played, this is a good strategy. Money is usually tight and order can be hard to keep at low development levels, so military buildings can feel like something of a luxury.