It only ever happens if the captain ends in a settlement after the battle, this is because the game then cannot track that captain down again.
No way around it.