See the frequent issues. You should be able to work around it by lifting the siege, waiting a turn and laying siege once more.