Yeah you may be right. I also believe now it's got something to do with missions because after removing them it seemed to run more stable.
I'll remove pirates next to see what happens.