When GAF had the thing against the words "bitch" and "cunt" a while back, I was personally very adamant against it, for the very same reasons people have listed in the thread. Now, obviously the word "exotic" is nowhere near as loaded, but the logic I used to justify it in my head was all the same: that the words really weren't all that bad, can have harmless connotations, and that people simply should not be so sensitive.
And really, when it came down to it, I hated the idea that I might have carelessly offended people, and if I could somehow justify their continued use, then I would be saved from the shame and embarrassment of having done wrong. I eventually realized that if I made someone feel bad, regardless of my intentions, and it is within my power to make amends and not make them feel that way in the future, the only reason I would find it difficult would be a missplaced sense of pride, and an overzealous attachment to the idea that I was, and always have been, a good person.