Yeah, start first by trying a different USB port. Then borrow someone else's iPod cable and try it with your iPod instead of your cable. Then try a different computer entirely with both cables, and try someone else's iPod on your machine with your cable. etc.

The iPod itself will turn on, right? Does it display a charge icon when it's plugged into the USB cable?