I honestly feel like this thread is going in an endless cycle and that the same things keep getting repeated and nothing is learned.
Nothing will ever get learned in threads like these on the Internet, because some people have decided in advance that there exist a "never get laid" box in which people can be inserted due to a label attached to them, or how they express their like for something, or the hobbies they have.
If you believe there is an objective score card for life, and that someone can literally "lose" being a human being based on criteria outside of being destructive, sociopathic, amoral, or a just plain feckless asshole... then you're always going to find it easy and convenient to go about dividing people into categories that, almost inevitably, lift you up while lowering them. Because I've rarely seen someone who thinks this way, fail to place themselves higher in life's imaginary leaderboard than the people they pass judgement on.
As has been stated in this thread your "life has gone wrong" if you are, say, a brony. This statement is completely ridiculous in its presumption to judge the complete life and existence of another human being, but that's how shallow (but convenient) attitudes can be. I believe the supposed justification for such attitudes would go like this: "But look! The brony has defined his entire life by this thing I say is silly and foolish! Therefore I may accurately observe that there is nothing to this person's existence than silly foolishness!"
Aside from the fact that this entire rig is based on the assumption that there's an objective standard for what is "silly", for what human beings should all be acting like, and behaving like (spoiler alert: there isn't), it is self deceiving to presume you understand everything about a person by a thin slice. The fact that said slice "outrageous" you means nothing.
Generally, I believe the most morally justifiable grounds on which to judge other people in life involve their attitudes, behavior, or activities inflicting harm on others or society. In point of fact, we commonly attempt to stretch definitions in order to pass judgement on others - we weasel our way to insinuating that someone is in fact causing some form of nebulous "harm" to someone, somewhere, in order to slap them with censure and feel justified. This is the kind of rationalization that, in more serious topics, forms the foundation of The Gay Scare, or racism, or transphobia as just a few examples: arguing that X person is deviating from one's claimed norm of behavior. And somewhere down the line, that's just got to be causing this critical harm to people and society, so they've got to be stopped right now. Even if the chain to this supposed harm is vague and illogical.
The brony thing really pulls that thinking into the spotlight because, yeah, it's pretty inevitable the clash of contexts is going to make a lot of people uncomfortable. There's plenty of insinuations flying around that "brony" by definition somehow vaguely and inevitably leads to "pedophile" among other things down the line.
The cold irony of this entire subject in the context of where we are, is that despite some defense oriented claims made on GAF, video games are not wholly accepted by society even now. Oh sure, they're a lot more normalized today. But sad to say, you'll still find plenty of people who laugh at people who play video games, say they're losers. And - wait for it, it's coming - snort that they will never get laid.
(Getting laid does seem to be the primary criteria by which to judge whether someone deserves to continue life in the world as we know it. People do realize that even those you think don't deserve it have probably had sex, and may be having it right now? It's not as difficult as you think.)
And fear of this condemnation is still strong in many people who play games (using games as the example for contrast, here). Plenty of people will, when pressed, go on about despising the term "gamer" because it invites associating them with a stereotypical group that they feel still receives censure from society.
Turtles made of scorn, all the way down.