It sounds like your modem needs some time to wake up.
Is there an LED that indicates the state of the modem?