I think a lot of this argument can be based on insecurities and fears that people have because of ignorance of those with different backgrounds. I posted this in another thread, but I just read some great blog entries at
www.whydoyoufearme.com on the fear that many westerners have toward Muslim people.
I for one have many Muslim friends but I am not a Muslim, and I find this site and its upcoming webcast to be really exciting!