I have not played EUII, but the standard reasoning is as follows:

If you want rigid historicity, play EUII. If you want historical plausibility play EUIII (Though you seriously need to download Magna Mundi...). If you do decide to get EUIII then make sure you get the expansions to go with it - they add a lot of great features and really flesh EUIII out.