Does building Ballista Towers, Catapult Towers and Barbicans continue to give a defensive advantage after the castle has been upgraded.

I'm wondering wether to build these things or am I better off just moving straight on to the next level.