Not really. If the game's reception is more positive then negative, there is no way that the average user score would be a 4 or 5. That is the point. It doesn't matter whether it is actually worthy of a 0 if the content of their review shows why they hated the game. Yes, a user may think it is worthy of a 10, but what makes it so when there are so many inherent flaws? Objectively, Destiny cannot be rated a 10 no matter how much fun you've had with it. There is a reason why there hasn't even been a single review that awarded it a perfect score. This not happening is actually rare for this type of hyped up game because there are usually at least a few reviewers who give big releases a 10 due to getting caught in the hype and overlooking flaws. This has not even occurred once with Destiny.
Also, it may "fuck up" the averages as you say, but this is no different than any other game. People award 10s and 0s based on how they feel, even if it's not a good way of rating the game. There is a reason why Destiny's user scores are much lower than the usual for this type of hyped up game. It can in no way be compared to CoD4 in terms of reception, the user scores DOUBLED Destiny's. We didn't make excuses for low user scores for any other game and there is certainly no reason to make excuses for Destiny now with user scores this low. Destiny is a flop in terms of reception, even Watch Dogs was slightly better received than this.
The metacritic "0s" argument doesn't even make sense because on other sites like Amazon where 0s aren't allowed the user scores are still low.