I concur.

I always hit the "p" key and then do the mouse work. Somewhat annoying.