You didn't know it was his work. You can't be blamed for insulting him directly. If he takes offense to that, then that's his problem, not yours.