How does the morale effect work ?

Does it need to be manned for it to work ? or does it work still if the guards have gone fighting elsewhere ?

Thx