The Hidden Flaws in Expert Judgment
In 2003, Michael Lewis documented how the Oakland Athletics used data to challenge traditional baseball wisdom. By finding value in players others overlooked, the team proved that even a century-old industry could be fundamentally wrong about how it measured success. This discovery suggested that if the market for baseball players was inefficient, perhaps every market was. This sparked a global movement to apply data analysis to everything from government to filmmaking, seeking to replace intuition with objective evidence.
Yet, the transition to data-driven decision-making remains difficult. When statistical models fail to predict a surprise election or a sports slump, there is a powerful urge to return to the judgment of seasoned professionals. Humans have a persistent hunger for experts who offer certainty, even when it is impossible. This tension reveals that the resistance to data is not just about a lack of information, but about the way the human psyche is wired.
The true source of these market inefficiencies lies in the inner workings of the mind. Experts often misjudge reality because their brains rely on specific shortcuts that warp their perspective. In baseball, visible traits like foot speed are often overvalued, while less flashy but effective skills are ignored. These systematic errors are not random; they are predictable patterns of thought that lead to flawed conclusions. These patterns were first identified by psychologists Daniel Kahneman and Amos Tversky. Their research into how people process evidence under uncertainty explained why even experienced professionals can be consistently wrong. By exploring how the mind functions when making decisions, they provided a framework for understanding why human judgment is so often prone to error. Their work suggests that to understand the world, one must first understand the biases inherent in the mind itself.
Full summary available in the Readsome app
