It's because they're small and fast and often have lots of little legs. People don't like mice for a similar reason, though mice have it better since they're mammals and people like mammals more than other forms of life for some strange reason.
Then there are those people who seem to express fear of butterflies...truly bizarre, that.