I think that a besieging army should also suffer attrition. Maybe not to the extent that the besieged suffers, but the besieger often suffered from problems with disease, raids, desertion etc.