Just for anyone else who might read this, you need to add the unit to every building level for the building type you want to produce them from :)