Pretty damning for AMD.
Sooner all the other sites update to this methodology the better.
Is it just crossfire/SLI stuff? Dont care, and definitely not many people use those, and they're already known to have issues compared to single cards (EG, the whole microstuttering thing in the past). Unfair to rush to blanket condemn AMD over that, seems like some fanboyism creeping in to it. Dont get me wrong, AMD needs to sort "it" whatever "it" is, but trying to make like there's something intrinsically wrong with AMD cards strikes me the wrong way. It's just something they can fix in drivers.
Interestingly Wasson started all this "AMD suck at advanced metrics" stuff, and his reviews actually seem to show Nvidia cards doing poorly just as often as AMD. It seems kinda random, really. Case in point their new 650 Ti Boost article which shows the card doing more poorly than AMD cards in 99th percentile metrics.
In a strange reversal of roles, it's Nvidia who has suffered from unruly frame latencies this time. Both versions of the GTX 650 Ti Boost fared poorly in Crysis 3 and Sleeping Dogs. They scored easy victories in the other games, but their 99th-percentile frame latencies weren't substantially higher than those of the Radeons.
Until there's consistency I dont know what to think. Anandtech is working on something though (they say FRAPS is not a good tool for this, so they're working on something else), and I'm guessing it'll be the gold standard cause that site tends to be.
One thing's for sure, Wasson started a major change and deserves a ton of credit.
But I also wonder if we arent going a little TOO far with this stuff sometimes. I mean I've been playing PC games for many years, and you know, my eyes arent the most sensitive, but they seemed smooth enough to me in the past, before all this frame latency stuff was a "thing" and we just used blind FPS as a measuring stick...I wonder if human eyes can really notice a lot of this stuff. I mean if PC games were really a stutterfest, well, we would have a had a lot of issues playing them in the past.
It'd be nice to get a consistent metric out of this that can be used across sites along with FPS oneday. We're not there yet it's early days.
This whole thing reminds me a tad of the sabermetrics stat revolution in baseball, almost, on a much smaller more narrow scale. A new way of thinking about things.