You do need to get the offer and build a Nanban port to convert( therefore already having one nullifies it, but I always get one before I'd be out conquering anyone else's), but after building a Nanban port you can still take others, which is a pretty nice trade boost.