(2007-06-19) Tetlock Political Judgment

Marc Andreessen recommends Philip Tetlock's Expert Political Judgment ISBN:0691128715 as reviewed by Louis Menand. More serious commentators differ from the pundits only in the degree of showmanship. These serious experts-the think tankers and area-studies professors-are not entirely out to entertain, but they are a little out to entertain, and both their status as experts and their appeal as performers require them to predict futures that are not obvious to the viewer. The producer of the show does not want you and me to sit there listening to an expert and thinking, I could have said that. The expert also suffers from knowing too much: the more facts an expert has, the more information is available to be enlisted in support of his or her pet theories, and the more chains of causation he or she can find beguiling. This helps explain why specialists fail to outguess non-specialists. The odds tend to be with the obvious... Low scorers look like hedgehogs: thinkers who "know one big thing," aggressively extend the explanatory reach of that one big thing into new domains, display bristly impatience with those who "do not get it," and express considerable confidence that they are already pretty proficient forecasters, at least in the long term. High scorers look like foxes: thinkers who know many small things (tricks of their trade), are skeptical of grand schemes, see explanation and prediction not as deductive exercises but rather as exercises in flexible "ad hocery" that require stitching together diverse sources of information, and are rather diffident about their own forecasting prowess. (contra Hedgehog Concept).

Tetlock also has an unscientific point to make, which is that "we as a society would be better off if participants in policy debates stated their beliefs in testable forms"-that is, as probabilities-"monitored their forecasting performance, and honored their reputational bets." He thinks that we're suffering from our primitive attraction to deterministic, overconfident hedgehogs. It's true that the only thing the electronic media like better than a hedgehog is two hedgehogs who don't agree. Tetlock notes, sadly, a point that Richard Posner has made about these kinds of Public Intellectual-s, which is that most of them are dealing in "solidarity" goods, not "credence" goods. (Accountability Arena)