dude, chill(ax). sex isn't a meritocracy. there's no scorecard for sexual viability except your game. you don't get laid just for lookin' good or bein' a big ol' brain. if you don't get out there and sell yourself -- even a little -- looks and money are well-on worthless. it's no comment on your overall worth as a person if you can't score with mega-hotties, unless you really REALLY care what other duders think. if it does bug you, i gotta question why it's so important to you that other dudes consider you a master of mack.
fez *is* better than you at sex. he's a top-notch player. you are not. i don't think that's the most admirable thing in the world, but it's something plenty of duders envy, and the practical reality is that being a player gets you prime pussy. if it pisses you off that he is better with the sort of women he bags and you obviously covet, maybe it's time to take a few pointers from his approach -- especially if you think you're comparable. if not, maybe you should be honest with yourself about your feelings on sex in general and what you really want from women.
also, let's face it: fez isn't talking about his failures, here. he's committed to the game, and a player won't talk to other dudes about the sexual embarrassments and failures that invariably come with serious game. he won't talk about the emotional issues it can cause, especially when some random skank announces she's pregnant and has to get an abortion, or when some chick he's boning goes off on a creepy crying jag and tells him she was molested when she was 10. frequent casual sex has a big price, and it's paid straight out of your character -- at least if you're even a mildly decent human being.
i think what ACTUALLY enrages you is just how much emotional effort you'll hafta make to get over your interpersonal hangups and connect with a woman, even casually. fez doesn't have that hurdle. lucky him; unlucky you. doesn't mean you can't succeed, though; it just means you'll hafta swallow your fears and insecurities and practice practice practice. learning to stomach rejection and keep moving is the only way for the chronically over-introspective to develop game.
alternatively, value sex less. it's all in your mind, and as long as you have confidence in yourself, either route is perfectly viable.