Weapons that drain magicka and magicka poisons could be effective. I haven't had much trouble with casters, but then I'm a rogue type and usually get some sneak attacks in before they even know I'm there.