In Japan when I tell people I'm studying Buddhism at university here they often ask, "Oh, but you're Christian, right?"
Um, no, I'm really Buddhist. Refuge vows and lay precepts.
In East Asia it is still quite very foreign and alien an idea that a non-Asian (for example a white guy) could actually be Buddhist (they evidently don't know the history of Buddhism in India, Central Asia and the Middle East!).
Back home in Canada it depends on where I go. I think my relatives think I'm a weirdo. Around university it is pretty liberal and trendy, so "being Buddhist" is cool, I guess. Very positive image. The atheist God Delusion thumpers don't have much to say to me, and one Baptist Christian woman sympathetically remarked, "Buddhism is really just a way of life."
I presently live in an international housing complex for foreign students and because I tell people I'm vegetarian, refrain from alcohol and meditate regularly, I seem to have a mostly positive reputation as being some kind of ultra-spiritual dude or something like that. A lot of people here deal with East Asian research so Buddhism inevitably comes up. I've been a consultant a number of times.
Oh, but this one time this Muslim from Tunisia asked me why I became Buddhist and not Muslim.
"Surely, if you wanted a religion, you'd investigate all of them! How could you not find Islam to be the most scientific?" We then went on to have a lengthy discussion of why I am not Muslim.