Polygon gives high scores to games despite their anti-consumer aspects / DRM strategy

Pretty sure the worst part about that Sim City reviews is releasing it so early while being reviewed in a bubble, that means they get to ignore the henious shit that goes down and the potential fuck ups of the social features while giving the game a high score that will trick their userbase into buying it.

We reviewed SimCity with pre-release code provided by EA, and played on one of their reserved servers. Server inavailability was a minor issue, at first, but after a handful of false starts over the course of an afternoon I experienced no problems.

While I did have one brief experience of being able to continue playing the game offline in a private server environment with no other invited players, in all other cases (about 8 separate times, over the course of three days) the game simply halted and waited, politely, for connectivity to be restored.

Nope, nothing bad bout this.
 
"Anti-consumer" has become a bit of a buzzword recently. It's being tossed around like fact in a lot of discussions, as if it's a well-understood thing that everyone understands the same way.

I certainly don't disagree that the games listed (Dead Space 3 and Sim City in particular) have some egregious problems that are bad for the end-user/consumer, but "anti-consumer" needs to stop being used as a catch-all for bad business decisions. Explain why it's anti-consumer. Explain why these are things that should affect reviews, or how these reviews should tackle these problems. I agree with the premise of this thread but that's just something that bugs me, I guess. Just saying, "Ha! It how microtransactions! You like anti-consumer bullshit!" doesn't really say much about the game, nor does it really foster discussion.

The real conversation should be: should reviews focus on business practice, or the gameplay itself? What line needs to be crossed before one affects the other?

Great post.

Giant Bomb spoke about this on their podcast recently and it really struck a chord with me. They also have gone in depth into discussing the problems with each of the business models of these games listed in the OP on their podcast. Which is definitely a start, I'd love to see that focus be put front and center into the reviews though.
 
"Anti-consumer" has become a bit of a buzzword recently. It's being tossed around like fact in a lot of discussions, as if it's a well-understood thing that everyone understands the same way.

I certainly don't disagree that the games listed (Dead Space 3 and Sim City in particular) have some egregious problems that are bad for the end-user/consumer, but "anti-consumer" needs to stop being used as a catch-all for bad business decisions. Explain why it's anti-consumer. Explain why these are things that should affect reviews, or how these reviews should tackle these problems.

I agree with the premise of this thread but that's just something that bugs me, I guess. Just saying, "Ha! It how microtransactions! You like anti-consumer bullshit!" doesn't really say much about the game, nor does it really foster discussion.

The real conversation should be: should reviews focus on business practice, or the gameplay itself? What line needs to be crossed before one affects the other?

The answer is both.

If a game is able to hold it's own weight and if the business practices aren't so terrible that they impede on the game itself, then that's truly a great game in the 21st century. If the business practices are exploitative and don't add anything to the game, the game's overall score and such should be lowered for impeding on the consumer's investment.

Hell, a reviewer can even say they don't mind the business practices for a game, but acknowledge that some people will not have an enjoyable experience of DRM or whatever that may put off some consumers.
 
I notice that three of those are by Arthur Gies. My understanding is that he just doesn't seem to care all that much about "always online" games, because that's the way they were designed. Judging by the reviews I've read that he's written, he seems to come at things from a "does it work as intended?" point of view, then follows that up with "does it work well?"

This isn't necessarily a bad way to review, but... hm. As an example, when I read his Dishonored review, I found myself left cold. I couldn't tell whether or not Arthur actually had fun playing the game. I've played plenty of mechanically sound games that still lacked a certain something that meant I didn't find them worthwhile, and Arthur's reviews tend not to give me a good idea of whether or not I'll actually enjoy them.

When I read reviews (especially those by Kollar, Plante, and Justin McElroy), I get a sense not only of how well the games work, but also how much personal enjoyment the authors derived from a game. This, to me, is valuable in a review.

I hate dissing anybody, especially someone I'd actually murder to work for, but yeah, just a thought.

That said, the way he and Pitts were talking on twitter yesterday was really off-putting. I get being irritated at assholes on the internet, but I feel like they went too far.

Funny, I usually get yelled at by GAF people for rating games too low!

Yeah.

I'll never let Forza Horizon go.

--

Personally, I wish people would review games some time after release, rather than rush to review them right away. STALKER, for instance, was eviscerated (and rightly so) upon release, but after patching, it's now one of the greatest video games of all time. Games like Diablo 3 have severe problems (my hardcore Diablo II brethren can explain them better than I can) that most reviewers didn't seem to notice because they didn't play it the way most reviewers played.

I also tend to find that my thoughts on a game change significantly after release (I liked Dead Space 3 when I played, now, I don't think so kindly and regret having spent $40 on it). If I had to burn through a game quickly, like Gies was tweeting about last fall (I think he did three in a week or something crazy like that), I don't think I'd be able to provide an accurate assessment of the game's quality. Going to go out on a limb here and say that I think this is where a lot of reviewer/gamer disparate scores come in. I know reviewers like to blame the grognards, and they're often right to do so, but I think some of them play through in genuinely unhealthy ways that might negatively impact their ability to provide a good review.

Chill. Relax. Let the game breathe. Mull it over for a few days. Maybe go back and play a section or two. Then talk about it.
 
I think it's fair to say that in most of these high-profile cases the common man's opinion is much more in line with Neogaf's than review sites.

If you look at user reviews on a variety of sites, anecdotal evidence, other forums, etc, I think it's safe to say that a lot of people were disappointed with D3. My coworkers complained about it non-stop.

It's possible that there is some silent majority of people who think games like D3 are the best games of all time but I don't see any evidence for that at all.

You proved my point excellently. The majority of the game buying public is not reading websites religiously like you and I are. They are watching TV ads and going to gamestop.
 
I don't get how micro-transactions are anti-consumer if all that stuff can just naturally be unlocked through ordinary play. Like a lot of people have pointed out, the ME3 multiplayer critique is a complete non-issue.
 
@Polygon 2:41 PM
[REVIEW UPDATE] Due to ongoing connectivity issues, we have lowered our current score for SimCity

Haha!

THIS THREAD WORKED. Phenomenal.

I'll give Polygon credit, they actually did it.

I'll be updating the OP to reflect this change accordingly.
 
Are product reviews the place for games criticism? I mean, I wouldn't hold the outlet reaponsable for a subjective evaluation by an individual. You can find the crusaders on soapboxes everywhere on the Internet.
 
I don't want to get off topic but I'd call the atrociously designed and completely broken combat a pretty major issue.

Explain this shit to me. I'm not even talking about Polygon right now, but I'm about 30 hours into the game and don't see how the combat is "broken" at all. It's not the most exciting part about Ni No Kuni (I think it's pretty well-designed), but it definitely works and I would not define it as "broken." The only messed-up thing about the game mechanics-wise is that it doesn't unlock all the gameplay mechanics until like 15 hours in.
 
aegies already tweeted they're updating the review.

The thing is they already benefited from rushing out a score for a game that doesn't exist. A game they were unsure would perform the way it performed for them under intense scrutiny from EA.

Putting out a revision now is like Kotaku slapping RUMOR on every anonymous forum post they find. Benefit from posting nebulous shit, but still try to pretend to be a credible source for information.
 
Other outlets were also allowed to play on these private servers and did. Polygon just decided their clicks were worth more than the correct assessment of the game in conditions the customer experiences it in.

And if they decide to score the game a bit down because the game is shittily playable for a few days, it won't matter. EA will be happy because Metacritic doesn't update scores of publications when there was a re-assessment.

So every publication: Score high until you're on Metacritic. People make reasonable objections, change the score to appease them but you get to keep the good publisher relation because on Metacritic you're still listed with the previous score while also appearing to be the guys that can "update the score to reflect the reality of the situation." Easy.
Quoting myself because I called this.

Metacritic put this in because of publisher pressure. How things have changed as the pressure is this time from the other direction.
Polygon truly is the new generation of review site.
 
@Polygon 2:41 PM
[REVIEW UPDATE] Due to ongoing connectivity issues, we have lowered our current score for SimCity
So fucking stupid. When somebody reads this in a week the score will be artificially low because of problems that don't exist anymore?

Can't believe they'd do something as stupid as that.
 
So are they just going to put it back to the original score next week when the online works again? Seems kind of pointless.

yes which is crazy

Nick Chester ‏@nickchester
@JustinMcElroy @Polygon Do you change the score back next week when EA/Maxis (presumably, maybe, probably) gets past this issue?
Expand
2 mins Justin McElroy ‏@JustinMcElroy
@nickchester Absolutely.
 
Then they are going to raise back up when that issue is fixed? Well, I guess if people like roller coaster rides...
 
Here's the review update text: http://www.polygon.com/game/simcity-2013/2630

As many worried, today's launch of SimCity has brought a number of server woes and instability with it. Some players are unable to connect to EA's servers to download the game. Others are unable to sign into SimCity's always-online service to start a game. Others are suffering from disconnections while in-game, which often results in lost progress and bizarre glitches. Our own reviewer, Russ Pitts, has suffered disconnected sessions this afternoon that resulted in lost progress, corrupted avenue placement, and twin monster attacks.

After speaking with Russ and Polygon Managing Editor Justin McElroy, we are in agreement that the current state of SimCity merits an update to the game's score on Polygon, per our reviews policy. While not every player is experiencing these problems, members of our staff, other members of the press, and an anecdotally large portion of our readership are having moderate to severe difficulty playing the game. This likely-temporary scenario nonetheless effects our recommendation of SimCity, and we advise caution for the time being before diving headfirst into the game. - Arthur Gies, Polygon Reviews Editor
 
Their job is to review the game.

Not the game or game company's business practices.

In the case of microtransactions, the business practice actually is part of the game, so that sounds fair to include. It's not like anyone's telling Polygon to detract scores based on a table of evil publishers.
 
So are they just going to put it back to the original score next week when the online works again? Seems kind of pointless.

Why does it matter? If it works, it works. Polygon has explicitly said that they intend for their reviews to reflect the current reality of a game. They've changed scores in the past as games have improved, and they'll change the SimCity score in the future if it improves as well.

As long as they notify people in the review that there is an always-on requirement (and they do, prominently), they're doing their job. If an always-only requirement permanently affected a review score even after server issues are resolved, that seems pointless.
 
Ha ha ha... way to stick to your guns, Polygon. I don't know what's worse, putting up an inaccurate review, or retconning the review score to match what their readers expect.

This is the biggest problem with this policy. They pushed out utter shit in the name of page views, and think that changing the score now is good enough. They should apologize for posting a review in the first place.
 
So are they just going to put it back to the original score next week when the online works again? Seems kind of pointless.


My thoughts exactly. I would think this part of their review process would benefit games that become better over time. This just seems like a minor slap on the wrist and will be fixed within a month.
 
@Polygon 2:41 PM
[REVIEW UPDATE] Due to ongoing connectivity issues, we have lowered our current score for SimCity

"Shit, remember when we said we were going to constantly update reviews? GAF remembered that shit. Uh, well... what did we put up today... SIM CITY! Great add a quick note in and change the score. Make sure to tweet it out. Did GAF see yet? YES! Wario posted it. Let's see what happens now."
 
HEoVhfG.png


Wow, right as we were in the midst of this topic this happens.

Amazing.
 
So fucking stupid. When somebody reads this in a week the score will be artificially low because of problems that don't exist anymore?

Can't believe they'd do something as stupid as that.

Or when they read it now on Metacritic they'd believe there's no problem at all!

Win-win scenario
not for gamers, of course, who still have to endure the trials of always online.
 
Everyone on staff does some reviews, just like everyone on staff does some features and some news. I did a feature on Swery recently, for example.

Russ reviewed SC because he's particularly knowledgable about city-building and sim games and was clearly the best choice on staff for it.

And Arthur Gies was the best choice for GoW: Ascension right? Lulz.
 
@Polygon 2:41 PM
[REVIEW UPDATE] Due to ongoing connectivity issues, we have lowered our current score for SimCity

If I am correct, Metacritic doesn't update from the original score. So they can give EA the high score and adjust later when it seems like a good PR move. Well played, Polygon.
 
I notice that three of those are by Arthur Gies. My understanding is that he just doesn't seem to care all that much about "always online" games, because that's the way they were designed. Judging by the reviews I've read that he's written, he seems to come at things from a "does it work as intended?" point of view, then follows that up with "does it work well?"

This isn't necessarily a bad way to review, but... hm. As an example, when I read his Dishonored review, I found myself left cold. I couldn't tell whether or not Arthur actually had fun playing the game. I've played plenty of mechanically sound games that still lacked a certain something that meant I didn't find them worthwhile, and Arthur's reviews tend not to give me a good idea of whether or not I'll actually enjoy them.

When I read reviews (especially those by Kollar, Plante, and Justin McElroy), I get a sense not only of how well the games work, but also how much personal enjoyment the authors derived from a game. This, to me, is valuable in a review.

I hate dissing anybody, especially someone I'd actually murder to work for, but yeah, just a thought.

I think this is the gist of the angst right here. The problem is not so much with reviews at large, but rather finding reviewers that share a similar attitude towards gaming as you do and then following those writers.

Justin McElroy has always stated - going back to when he was still with Joystiq - that while he will talk about mechanics and production value, at the end of the day, his scores are about how much fun he had, or how impactful the experience was.
 
Always online DRM doesn't work at launch?

WHO WOULD'VE THUNK?

Always online/always online DRM needs to go to an abyss and never crawl back out.
 
even though i'm familiar with its usage in the realm of social activism, i've always been confused by the usage of "anti-consumerism" on these forums and various other gaming sites so maybe somebody can clear it up for me... so how exactly is a product anti-consumer in a completely voluntary market?
 
Just saw someone point out that Polygon is just changing the score cause of connection issues. It should be reflected on game design
 
It's about not acknowledging the anti-consumer stances that these games take in their review scores.[/B]

Why does this have to be refleced in the score? Why does anything have to be acknowledged in the score? Why can't people just read the review?

From Polygon's Sim City Review:

SimCity demands a constant connection to the EA servers, through Origin, in order to play. This can be problematic at times, but in my experience with SimCity, it was also (when it worked) seamless.

We reviewed SimCity with pre-release code provided by EA, and played on one of their reserved servers. Server inavailability was a minor issue, at first, but after a handful of false starts over the course of an afternoon I experienced no problems.

More problematic (for me) was my home network set-up and a wi-fi router that has taken to dropping connections of late. If you lose an internet connection while playing SimCity will most likely stop and you will be forced back to the loading screen. Sucks to be whatever sims you may have been trying to help or rescue. If you do not have a connection when you try to start playing, the game will not start.

While I did have one brief experience of being able to continue playing the game offline in a private server environment with no other invited players, in all other cases (about 8 separate times, over the course of three days) the game simply halted and waited, politely, for connectivity to be restored.

While an impromptu (but costly) router upgrade solved my wi-fi problem, the server issues were beyond my control, and the lesson lingered. It remains to be seen if EA's servers will be up to the task of hosting however many simultaneous SimCity games will be played post-release. And those with unreliable internet connections may need to consider if the ability to play SimCity is worth an upgrade of either your service provider or equipment, which may be a cost too high to bear.

It is arguments like this that make me wish more reviewers put less emphasis on scores and more on the actual body of the review. Also, why should a score reflect an issue that is not relevant with 100% of the consumer base? There is a reason why broken mechanics or content or whatever affect review scores... since they affect everyone, but only people with shitty connections are affected by an always online DRM, why should the score reflect that when like stated above, so many people simply take into account review scores without reading the actual review... all of a sudden MORE people don't buy the game because of the reviews for an issue they may never even have any problem with.
 
What's wrong with the combat? Works pretty awesome. Not the deepest, but better than many JRPGs. Takes the pokemon concept to a whole new level.

Explain this shit to me. I'm not even talking about Polygon right now, but I'm about 30 hours into the game and don't see how the combat is "broken" at all. It's not the most exciting part about Ni No Kuni (I think it's pretty well-designed), but it definitely works and I would not define it as "broken." The only messed-up thing about the game mechanics-wise is that it doesn't unlock all the gameplay mechanics until like 15 hours in.



Again this is off topic so I'm sorry I brought it up here. I've done a mini detail of all the problems with Ni no Kuni's combat in the OT. If you want to know why I thought the game's combat was such a mess go read that.
 
@Polygon 2:41 PM
[REVIEW UPDATE] Due to ongoing connectivity issues, we have lowered our current score for SimCity

The 95 score is already on Metacritic.

As many worried, today's launch of SimCity has brought a number of server woes and instability with it. Some players are unable to connect to EA's servers to download the game. Others are unable to sign into SimCity's always-online service to start a game. Others are suffering from disconnections while in-game, which often results in lost progress and bizarre glitches. Our own reviewer, Russ Pitts, has suffered disconnected sessions this afternoon that resulted in lost progress, corrupted avenue placement, and twin monster attacks.

Sounds like an 8!
 
I think games should be reviewed for their content, not the way they're delivered to the user (which may change over time). Imagine TV show reviewers giving lower scores because the network went overboard with commercial breaks or something to that effect. DRM and other problems may be mentioned in a separate frame, but they should not impact the score, unless the game is downright unplayable for everybody.
 
I don't get how micro-transactions are anti-consumer if all that stuff can just naturally be unlocked through ordinary play. Like a lot of people have pointed out, the ME3 multiplayer critique is a complete non-issue.

Same with the DS3 criticisms. Either that, or I am a Dead Space God because I got through solo Impossible on my virgin run without having to spend real money. :p
 
HEoVhfG.png


Wow, right as we were in the midst of this topic this happens.

Amazing.

Guess what EA's PR people will get bonuses from: 9.5

Guess who benefits from knowingly posting an inaccurate review: Polygon

Good arrangement for everyone except consumers.
 
Haha!

THIS THREAD WORKED. Phenomenal.

I'll give Polygon credit, they actually did it.

I'll be updating the OP to reflect this change accordingly.

They said yesterday that they'd change it accordingly if the game's connectivity was screwed up. I doubt this thread had any impact.
 
Top Bottom