I think we are all inately more warry of people the more different they are from us. There's nothing really wrong with that, so long as we realise that it's an instinctive reaction rather than a reasoned one.

The Asian Muslim didn't make you uncomfortable just because he's Asian or Muslim but because he's different. Had he been a white Muslim or an Asian Christian you likely would have been more comfortable.

Having said that, the current geo-politcal situation and religious tensions in the world are going to start tripping alarms in the back of your head.