No, if you stand at the same tile as an enemy watchtower you control it. You can try it out in any campaign and you'll see that it works