So your map_heights.tga has smooth edges to the coasts? You haven't resized map_regions to give you the shore outline? Have you tried making sure that all coasts are very low lying?
Just a couple of ideas. The coasts will always be a little bit jagged.
Bookmarks