It seems to be the CPU that takes a massive hit. If you pause the game, the framerate usually becomes acceptable, which would suggest to me that it's the pathing or the AI that's causing the FPS hit.