I experienced this during my first bridge battles too. It happens when you cram your units together in a small area. Every unit needs a certain amount of space or else they will suffer a penalty for being crammed together. Just make your formation somewhat more spacious and leave your troops a little space to move in.