Remove the lightbulb from the lamp and insert the other one I have in my inventory.

Then walk to the switch by the door and turn it on.