Rome's worst enemy was, without a doubt, Rome itself.

The so-called "barbarian invasions" that lead to the utter demise of the [Western] Roman Empire were only a coup de grace delivered to a dying and decaying empire.