Somehow I forgot how to do this

[Come Together]

Select them all, hit Cntrl + 1(or whatever button) and they should stay in the formation you put them in, unless you changed it to one of the predifined formations.