yesterday i lost Castile to something ridiculous like one unit of French catapults cuz i had no army there for that turn

the next turn i took Castile back, and i destroyed 4 of my own buildings wtf?

i did not WANT to destroy those buildings, nor did i CHOOSE to destroy those buildings. so WHY were they destroyed? that ticks me off A LOT. how do i not destroy buildings when taking back MY OWN BUILDINGS?