Thank you for the suggestions. I play with script activated and on M/M. Unfortunately on close examination with FoW off, I saw that those stacks get spawned the turn after I besiege a settlement right next to me and attack, so picking them up beforehand would not work. Maybe I should reinstall.