Perhaps, but it's the idea itself. I mean hypothetically, a President could poison all of the Justices (their old, no one would be suprised if they died), and put in his own bunch to pass any laws that he liked. Just like FDR tried...
But you have a point, it's always easier to disagree with something when it goes against you as opposed to helps your views.