I think some of the misconception comes from various guides saying it is a waste to attack unarmored units with AP units. It's not that they are worse, it's just that they could be better utilized on an armored opponent. I think this got misinterpreted into "don't use AP units against non-armored ones".