Eventual elites typically devote less time early on to deliberate practice in the activity in which they will eventually become experts. Instead, they undergo what researchers call a “sampling period.” They play a variety of sports, usually in an unstructured or lightly structured environment; they gain a range of physical proficiencies from which they can draw; they learn about their own abilities and proclivities; and only later do they focus in and ramp up technical practice in one area. The title of one study of athletes in individual sports proclaimed “Late Specialization” as “the Key to Success”; another, “Making It to the Top in Team Sports: Start Later, Intensify, and Be Determined.”
And I was stunned when cognitive psychologists I spoke with led me to an enormous and too often ignored body of work demonstrating that learning itself is best done slowly to accumulate lasting knowledge, even when that means performing poorly on tests of immediate progress. That is, the most effective learning looks inefficient; it looks like falling behind.
One of Klein’s colleagues, psychologist Daniel Kahneman, studied human decision making from the “heuristics and biases” model of human judgment. His findings could hardly have been more different from Klein’s. When Kahneman probed the judgments of highly trained experts, he often found that experience had not helped at all. Even worse, it frequently bred confidence but not skill.
The domains Klein studied, in which instinctive pattern recognition worked powerfully, are what psychologist Robin Hogarth termed “kind” learning environments. Patterns repeat over and over, and feedback is extremely accurate and usually very rapid. The learning environment is kind because a learner improves simply by engaging in the activity and trying to do better.
In wicked domains, the rules of the game are often unclear or incomplete, there may or may not be repetitive patterns and they may not be obvious, and feedback is often delayed, inaccurate, or both. In the most devilishly wicked learning environments, experience will reinforce the exact wrong lessons.
There is a saying that “chess is 99 percent tactics.” Tactics are short combinations of moves that players use to get an immediate advantage on the board. When players study all those patterns, they are mastering tactics. Bigger-picture planning in chess—how to manage the little battles to win the war—is called strategy. As Susan Polgar has written, “you can get a lot further by being very good in tactics”—that is, knowing a lot of patterns —“and have only a basic understanding of strategy.”
Where the very thoughts of premodern villagers were circumscribed by their direct experiences, modern minds are comparatively free. This is not to say that one way of life is uniformly better than another. As Arab historiographer Ibn Khaldun, considered a founder of sociology, pointed out centuries ago, a city dweller traveling through the desert will be completely dependent on a nomad to keep him alive. So long as they remain in the desert, the nomad is a genius.
But it is certainly true that modern life requires range, making connections across far-flung domains and ideas. Luria addressed this kind of “categorical” thinking, which Flynn would later style as scientific spectacles. “[It] is usually quite flexible,” Luria wrote. “Subjects readily shift from one attribute to another and construct suitable categories. They classify objects by substance (animals, flowers, tools), materials (wood, metal, glass), size (large, small), and color (light, dark), or other property. The ability to move freely, to shift from one category to another, is one of the chief characteristics of ‘abstract thinking.’”
Kornell was explaining the concept of “desirable difficulties,” obstacles that make learning more challenging, slower, and more frustrating in the short term, but better in the long term. Excessive hint-giving, like in the eighth-grade math classroom, does the opposite; it bolsters immediate performance, but undermines progress in the long run. Several desirable difficulties that can be used in the classroom are among the most rigorously supported methods of enhancing learning, and the engaging eighth-grade math teacher accidentally subverted all of them in the well-intended interest of before-your-eyes progress. One of those desirable difficulties is known as the “generation effect.” Struggling to generate an answer on your own, even a wrong one, enhances subsequent learning. Socrates was apparently on to something when he forced pupils to generate answers rather than bestowing them. It requires the learner to intentionally sacrifice current performance for future benefit.
Psychologist Robert Bjork first used the phrase “desirable difficulties” in 1994. Twenty years later, he and a coauthor concluded a book chapter on applying the science of learning like this: “Above all, the most basic message is that teachers and students must avoid interpreting current performance as learning. Good performance on a test during the learning process can indicate mastery, but learners and teachers need to be aware that such performance will often index, instead, fast but fleeting progress.”
Deep analogical thinking is the practice of recognizing conceptual similarities in multiple domains or scenarios that may seem to have little in common on the surface.
The trouble with using no more than a single analogy, particularly one from a very similar situation, is that it does not help battle the natural impulse to employ the “inside view,” a term coined by psychologists Daniel Kahneman and Amos Tversky. We take the inside view when we make judgments based narrowly on the details of a particular project that are right in front of us.
“Match quality” is a term economists use to describe the degree of fit between the work someone does and who they are—their abilities and proclivities.
Dark horses were on the hunt for match quality. “They never look around and say, ‘Oh, I’m going to fall behind, these people started earlier and have more than me at a younger age,’” Ogas told me. “They focused on, ‘Here’s who I am at the moment, here are my motivations, here’s what I’ve found I like to do, here’s what I’d like to learn, and here are the opportunities. Which of these is the best match right now? And maybe a year from now I’ll switch because I’ll find something better.’”
Each dark horse had a novel journey, but a common strategy. “Shortterm planning,” Ogas told me. “They all practice it, not long-term planning.” Even people who look like consummate long-term visionaries from afar usually looked like short-term planners up close.
She is a “T-shaped person,” she said, one who has breadth, compared to an “I-shaped person,” who only goes deep, an analog to Dyson’s birds and frogs. “T-people like myself can happily go to the I-people with questions to create the trunk for the T,” she told me. “My inclination is to attack a problem by building a narrative. I figure out the fundamental questions to ask, and if you ask those questions of the people who actually do know their stuff, you are still exactly where you would be if you had all this other knowledge inherently.
It’s mosaic building. I just keep putting those tiles together. Imagine me in a network where I didn’t have the ability to access all these people. That really wouldn’t work well.”
There is a particular kind of thinker, one who becomes more entrenched in their single big idea about how the world works even in the face of contrary facts, whose predictions become worse, not better, as they amass information for their mental representation of the world.
Eventually, Tetlock conferred nicknames (borrowed from philosopher Isaiah Berlin) that became famous throughout the psychology and intelligence-gathering communities: the narrow-view hedgehogs, who “know one big thing,” and the integrator foxes, who “know many little things.”
The hedgehogs, according to Tetlock, “toil devotedly” within one tradition of their specialty, “and reach for formulaic solutions to ill-defined problems.” Outcomes did not matter; they were proven right by both successes and failures, and burrowed further into their ideas. It made them outstanding at predicting the past, but dartthrowing chimps at predicting the future. The foxes, meanwhile, “draw from an eclectic array of traditions, and accept ambiguity and contradiction,” Tetlock wrote. Where hedgehogs represented narrowness, foxes ranged outside a single discipline or theory and embodied breadth. Incredibly, the hedgehogs performed especially poorly on long-term predictions within their domain of expertise. They actually got worse as they accumulated credentials and experience in their field. The more information they had to work with, the more they could fit any story to their worldview.
Read date: September 2020
Therese's Little Corner - Musings of a Millennial 
Leave a comment