The Illusion of Validity

Today’s New York Times Magazine had an article about the hazards of confidence, by Nobel Prize-winning economist Daniel Kahneman, adapted from his forthcoming book Thinking, Fast and Slow. Kahneman describes some team-building exercises he engaged in many years ago in the Israeli Army, that were used to predict the leadership qualities of soldiers. It turned out that these exercises had no predictive power whatsoever, yet those who participated and evaluated the results continued to believe in their value, even after seeing their lack of predictive power. It must just seem intuitively obvious that those who exhibit the most skill at such tasks as figuring out how to get the team over a wall, would perform best at leadership tasks in the military. Kahneman calls this cognitive fallacy, the illusion of validity.

Kahneman noticed a similar phenomenon in studying the work of stock traders. He discusses studies showing that stocks that traders sell actually out-perform the stocks they continue to hold. It seems that a lot of stock traders would show just as good or better results if they didn’t even bother coming to work. Kahneman once analyzed the performance of a group of investment advisers, finding that none of these advisers managed to out-perform the others when their results were compared over a number of years, suggesting that theirs is a game of chance more than skill. Yet every year, bonuses were awarded based on individual performance, and the best-performing advisers each year no doubt congratulated themselves on the results they had achieved for their clients. These economic and psychological studies show that it is difficult to shake people’s belief in their own powers of prediction, or in the validity of the tools they use to make decisions, even when those tools are shown to have no predictive power.

In mediation, we see these kinds of cognitive fallacies, and others, all the time. Parties and their attorneys make predictions of success based on inadequate or even misleading or worthless information. Parties believe, understandably, in the validity of their positions; and attorneys are expected to show confidence in their clients’ cases, as well as in their own skills. Part of the mediator’s job may be to shake people’s confidence in their predictive powers, something that Kahneman’s work suggests may be impossible to do. It is also a tricky thing to attempt when the mediator is at the same time trying to show empathy and understanding for each party’s predicament. So I might tell a party that they should place great reliance on their attorney’s evaluation that they have a 75% chance of winning their case at trial. But they might also want to take into account that the other side’s attorney thinks their side has a 75% chance of winning. It’s not that either attorney is wrong, it’s that the outcome of cases might be a bit harder to predict than people think it is.

(Tim Enthoven illustration from NY Times article)

                        author

Joe Markowitz

Joseph C. Markowitz has over 30 years of experience as a business trial lawyer.  He has represented clients ranging from individuals and small businesses to Fortune 500 corporations.  He started practicing with a boutique litigation firm in New York City, then was a partner in a large international firm both… MORE >

Featured Mediators

ad
View all

Read these next

Category

Two Presentations

From Colin Rule's blog. Video of two recent presentations of mine are now on the web, just in case you might not have been able to catch them in person....

By Colin Rule
Category

Mediation and Access to Justice for All: The Case of Unrepresented Parties

Legal systems round the globe are grounded in the rule of law and in theory, justice is available readily and equally to all. In practice, however, access to justice is...

By Bongkiyi John Paul
Category

Mediation Vignette: Christmas Lights, Holograms and Shadows

This is another in a series of vignettes, culled from mediations conducted by the author. In this vignette, a young woman loses her family and hope and the mediator stumbles...

By John R. Van Winkle

Find a Mediator

X
X
X