This actually has made me a much more open, relaxed person in social situations. I still can't just bring up anime out of nowhere, but I finally feel ok with talking about videogames and being generally seen as a nerd.
Everyone's a nerd about something and people generally like enthusiastic people, so being reserved about something isn't going to make you like it less, you'll just be more reserved.
I just hope people can understand that Kamen Rider != Power Rangers. I'll keep that in mind.
Passion can change minds. I've gotten quite a few people into anime just by talking about it passionately, since they never even thought to give it a chance until they saw that it could inspire such fervent fandom. If you talk about Kamen Rider (Not like, all the time, mind you) you might be able to make people give it more of a chance or introduce them to something they never would have known about.
Plenty of people near our general age loved Power Rangers as a kid, so it's actually not all that hard of a thing to introduce them to if they're not an asshole.
