Doing it to secure a border seems alright to me. Punitive action, you might call it. If you attack these settlements for experience every other turn, you venture into the borders of gameyness, imho. It comes down to how you balance your own game, I think.

Now, a question I've been asking when considering this: How can you be sure the settlement doesn't revolt to its previous owner?