Are you sure they were losing it and not gaining it?

My troops start off collecting bronze bars and when they get a set of three they trade them in for one silver one. Or at least thats what I thought they were doing.