As the others said. No crossed swords in siege type situations. The swords always appears in the center of the 3x3 red outlined square on the pre-battle screen. In sally/assault type situations, that center is the settlement and thus the swords do not appear.