Gaborn said:
Edit: I don't think that's quite fair. All he's basically doing is inputting all of the "players" in a given situation and using scaled models of their tendencies, putting them together and then using that to calculate a given most likely outcome. He's not claiming that he's always going to be right, and there has been a TON of media sensationalism around him (calling him the "next Nostradamus" for example), but this is just basically applying a statistical model to human behavior, which can't (and doesn't) claim to be perfect, but has so far been pretty far above average. As he points out repeatedly his models are only as good as the assumptions he makes on input (and the article mentions he gets advice on the input from multiple analysts of his chosen subject matter to present the "best" picture possible). His methodology is never going to be "perfect" because there's always a chance for a complete unknown or random factor to change a situation, but denying outright that his model has worked in the past isn't fair at all.
Game theory is an interesting subject, as is rational choice theory and all that.
there are a few problems though:
a) People don't behave rationally.
b) As you mention, we don't have the right/good data for those models. it is a huge fucking caveat. It's like trying to design the wing of a plane without knowing any of the coefficients of the fluid you're traveling in, and come up with mostly magical numbers, and hope the goddamn thing flies.
c) No model except the absolute simplest ones can be 'solved' on a computer. He may impress journalists when he says 'i plug in the number, and here goes!', but computing an equilibrium is extremely computationally heavy. _Extremely_ so. His models have to be utterly simplistic representation of reality.
d) even when you can solve those models, they will rarely give you an answer of what actually happens. They will give you a number of different possibilites ('equilibrium') and choosing which one is 'right' is pretty much arbitrary**. Given the system he studies, the right answer should most of the time 'no fucking clue', because in all odds everything can happen.
Does it mean it's junk? I don't know. It does not really bring anything conceptually new to the field. He just makes predictions, which may or may not be correct.
I have that British Political science article (which quotes the 90 percent success rate) if you want (I'll pm it to you if you'd like, I don't really know if that's kosher here), and, from a quick read, nothing indicates independent validation of those magical 90% (which btw, should be a dead ringer of a faux-nostradamus). We don't know who validated those besides one random CIA dude (for which there are many potential reasons to distrust his opinion).
90% sounds great, but on what? Ridiculously easy predictions? Hard ones? Is he predicting the weather in ten minutes, or in ten months?
No record of him making those 'interesting' predictions (that list which is given anywhere you read about him) before they actually happened, or before they were about to become obvious, or if just generates gazillions of possible scenario and only pulls the correct ones out of his hat.
Let me amend my statement. it's not necessarily gibberish. But all clues point, imo, to a guy who make much much more grandiose claims than what he actually is able to do , and abusing the credulity of people who can pay for his consulting services and who desperately need a crystal ball (like intelligence people). But i guess that's what all consultants do.
I wouldn't mind as much if he was an academic who wanted to know how predictable real world events are (based on the kind of data he feeds his model), plays around with it, warns that any conclusion has to be taken with the fucking hugest pinch of salt ever, and analyzes the results. I do think game theory is very interesting to understand at a very high level human behavior, but pretend you're actually able to predict what happens is what is nonsense in my eyes.
This guy just claims he is correct pretty much all the time and spends governement money and what is most likely barely above magic 8 ball predictions level.
** for a simple example,
http://en.wikipedia.org/wiki/Matching_pennies (one equilibrium, but it's completely random)
or
http://en.wikipedia.org/wiki/Chicken_(game)
(three equilibrium, all equally valid)
edit: apologies if the above reads as an unstructured rant. I have never been much of a writer.