Predicting the future - 90% accurate using Game Theory, according to Bueno de Mesquita

Posted by Marshall on October 31, 2007 | Link It

Game Theory could be an application of Analytics, I suppose - apparently there's someone, Bueno de Mesquita, who developed a way to predict the future accurately 90% of the time using Game Theory, according to David Pescovitz at BoingBoing in a post about Game theory and future forecasting - "…game theory, an esoteric branch of mathematics used to analyze interaction. “Game theory is math for how people behave strategically,” Bueno de Mesquita:

"…He's consulted for the CIA, the Department of Defense, and Fortune 500 companies to help generate forecasts using a computerized game theory model. He's recently worked with the US government on the conflict with Iran. However, he says his private consultancy corporate policy bars him from saying, "on a commercial basis," who will be the next president of the United States. From Science News:

The details of his study of negotiation options with Iran are classified, but Bueno de Mesquita says that the broad outline is that there is nothing the United States can do to prevent Iran from pursuing nuclear energy for civilian power generation. The more aggressively the U.S. responds to Iran, he says, the more likely it is that Iran will develop nuclear weapons. The upshot of the study, Bueno de Mesquita argues, is that the international community needs to find out if there is a way to monitor civilian nuclear energy projects in Iran thoroughly enough to ensure that Iran is not developing weapons.

One of his most famous past predictions also concerned Iran. In 1984, the model predicted that when Ayatollah Khomeini died, an ayatollah named Hojatolislam Khameini and a little-known cleric named Hasheimi Rafsanjani would rise to succeed Khomeini as leaders of Iran. At the time, most experts considered that outcome exceedingly unlikely, since Khomeini had designated a different person as his successor. But in fact, when Khomeini died five years later, Rafsanjani and Khameini succeeded him. "

The article on The New Nostradamus for Good Magazine mentions a point that Burno de Mesquita made about accuracy of input:

"…he’ll claim that mathematics can tell you the future. In fact, the professor says that a computer model he built and has perfected over the last 25 years can predict the outcome of virtually any international conflict, provided the basic input is accurate. What’s more, his predictions are alarmingly specific. His fans include at least one current presidential hopeful, a gaggle of Fortune 500 companies, the CIA, and the Department of Defense. Naturally, there is also no shortage of people less fond of his work. “Some people think Bruce is the most brilliant foreign policy analyst there is,” says one colleague. “Others think he’s a quack.”

The CIA is using de Mesquita's approach for quite some time and tested it and it came up over 90% accurate in those tests:

"..To verify the accuracy of his model, the CIA set up a kind of forecasting face-off that pit predictions from his model against those of Langley’s more traditional in-house intelligence analysts and area specialists. “We tested Bueno de Mesquita’s model on scores of issues that were conducted in real time—that is, the forecasts were made before the events actually happened,” says Stanley Feder, a former high-level CIA analyst. “We found the model to be accurate 90 percent of the time,” he wrote. Another study evaluating Bueno de Mesquita’s real-time forecasts of 21 policy decisions in the European community concluded that “the probability that the predicted outcome was what indeed occurred was an astounding 97 percent.” What’s more, Bueno de Mesquita’s forecasts were much more detailed than those of the more traditional analysts. “The real issue is the specificity of the accuracy,” says Feder. “We found that DI (Directorate of National Intelligence) analyses, even when they were right, were vague compared to the model’s forecasts. To use an archery metaphor, if you hit the target, that’s great. But if you hit the bull’s eye—that’s amazing.”

 



2 Responses

These are the current comments for "Predicting the future - 90% accurate using Game Theory, according to Bueno de Mesquita"

11/02/07 @ 4:42 pm

There is a story in Freakanomics about a retired US Marine general going up against a similar situation during a war game. In the story, the General beat the computer by using tactics that weren’t accounted for by the machine.

The story itself is an interesting read, and it highlights how these kinds of simulations are only as good as the variables that are fed to it. If the variables change, say due to innovation or poor intelligence, the results can be disastrous.

The bottom line of the story is that these models can be both incredibly accurate and helpful, but they don’t take out the element of human innovation, and don’t necessarily negate the value of “gut feelings”.



Anonymous
11/09/07 @ 9:18 am

I believe that the story does mention the fact that the predictions are only as accurate as the input it recieves. The key aspect of the problem is, given accurate data, how to predict accurately an outcome. From the article, it seems that Mesquita has managed to produce a Mathematical model that is very accurate. That is outstanding. My guess is that his model will have to be tweaked constantly. On the other hand, my guess is that his model is not dependent on specific cultural factors which makes the article more incredible.



Post a Response

Name (required)

Email (required, not published)

Website (optional)

Note: The following tags are approved for comments on this blog:
<a href=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <code> <em> <i> <del> <strong>