Hmm that's really strange. I've only noticed random units taking a few casualties in the post battle report if I first select to continue to chase rouers but then quit after that. Never seen them get extra kills though.