Build points for siege stuff will be there next time you siege.

It seems to be a function of army size and the general's traits/retinue.

Welcome to the .org