As I understand it, the emperor's legal claim to authority was that the senate "voluntarily" (ahem) granted him authority, and (theoretically, though not in practice) could take his authority away. In theory, the senate was still in charge. Its the old distinction between de facto and de jure.