Power supplies are the most common replacement component I find when fixing computers - they fail more frequently than any other part, and can damage other parts in the system while they're going out.

Borrow or buy a replacement PSU, install it and run some low-level diagnostics - not Windows programs. If things check out at that point, you can move up to Windows utilities and wring out the video card, processor, etc.