- Do you bring this trick out at parties? - Oh no. It's a terrible party trick. Here we go. 3.141592653589793 - This is Grant Gussman. He watched an old video of mine about how we think that there are two systems of thought. System two is the conscious
slow effortful system. And system one is subconscious. Fast and automatic. To explore how these systems
work in his own head, Grant decided to memorize
a hundred digits of pi. - Three eight four four six... - Then he just kept going. He has now memorized 23,000 digits of pi in preparation to challenge
the north American record - .95493038196. That's 200. (Derek laughs) - That's amazing. I have wanted to make a video
about experts for a long time. This is Magnus Carlsen, the five time world chess champion. He's being shown chessboards and asked to identify the
game in which they occurred. - This looks an awful
lot like Tal V Botvinnik. (playful music) - Whoops. - Okay. This is the 24th
game from Sevilla obviously. (chuckling) - Now I'm going to play
through an opening. And stop me when you recognize the game. And if you can tell me who
was playing black in this one. Okay. (playful music) I'm sure you've seen this opening before. - Okay. It's gonna be Anand. (laughs) - Against? - Zapata. - How can he do this? It seems like superhuman ability. Well decades ago, scientists wanted to know what makes experts like
chess masters special. Do they have incredibly high IQ's, much better spatial
reasoning than average, bigger short term memory spans? Well, it turns out that as a group, chess masters are not exceptional
on any of these measures. But one experiment showed how their performance was
vastly superior to amateurs. In 1973, William Chase and Herbert Simon recruited three chess players, a master, an A player, who's an advanced amateur, and a beginner. A chess board was set
up with around 25 pieces positioned as they might be during a game. And each player was allowed to look at the board for five seconds. Then they were asked to replicate the setup from memory on a second board in front of them. The players could take as many five second peeks as they needed to get their board to match. From just the first look, the master could recall
the positions of 16 pieces. The A player could recall eight, and the beginner only four. The master only needed
half the number of peeks as the A player to get
their board perfect. But then the researchers
arranged the board with pieces in random positions that would never arise in a real game. And now, the chess master performed no better than the beginner. After the first look, all players, regardless of rank could remember the location
of only three pieces. The data are clear. Chess experts don't have
better memory in general, but they have better memory specifically for chess positions that
could occur in a real game. The implication is what makes
the chess master special, is that they have seen lots
and lots of chess games. And over that time, their brains have learned patterns. So rather than seeing individual pieces at individual positions, they see a smaller number of
recognizable configurations. This is called 'chunking'. What we have stored in long-term memory allows us to recognize complex
stimuli as just one thing. For example, you recognize this as pi rather than a string of
six unrelated numbers or meaningless squiggles for that matter. - There's a wonderful
sequence I like a lot which is three zero one seven three. Which to me, means Stephen
Curry number 30, won 73 games, which is the record back in 2016. So three oh one seven three. - At its core, expertise
is about recognition. Magnus Carlsen recognizes chess positions the same way we recognize faces. And recognition leads
directly to intuition. If you see an angry face, you have a pretty good idea of what's gonna come next. Chess masters recognize board positions and instinctively know the best move. - Most of the time, I know what to do. I don't have to figure it out. - To develop the long
term memory of an expert takes a long time. 10,000 hours is the rule of thumb popularized by Malcolm Gladwell, but 10,000 hours of practice
by itself is not sufficient. There are four additional
criteria that must be met. And in areas where these
criteria aren't met, it's impossible to become an expert. So the first one is many
repeated attempts with feedback. Tennis players hit hundreds
of fore hands in practice. Chess players play thousands of games before they're grand masters and physicists solve
thousands of physics problems. Each one gets feedback. The tennis player sees whether each shot clears
the net and is in or out. The chess player either
wins or loses the game. And the physicist gets the
problem right or wrong. But some professionals don't
get repeated experience with the same sorts of problems. Political scientist, Philip
Tetlock picked 284 people who make their living
commenting or offering advice on political and economic trends. This included journalists, foreign policy specialists, economists, and intelligence analysts. Over two decades, he peppered them with questions like Would George Bush be re-elected? Would apartheid in South
Africa end peacefully? Would Quebec secede from Canada? And would the .com bubble burst? In each case, the pundits
rated the probability of several possible outcomes. And by the end of the study, Tetlock had quantified 82,361 predictions. So, how did they do? Pretty terribly. These experts, most of whom
had post graduate degrees, performed worse than if they had just assigned equal probabilities
to all the outcomes. In other words, people who spend their time and earned their living
studying a particular topic, produce poorer predictions
than random chance. Even in the areas they knew best, experts were not significantly
better than non-specialists. The problem is, most of the events they have
to predict are one-offs. They haven't had the experience of going through these events or very similar ones many times before. Even presidential elections
only happen infrequently, and each one in a slightly
different environment. So we should be wary of experts who don't have repeated
experience with feedback. (upbeat music) The next requirement
is a valid environment. One that contains regularities that make it at least
somewhat predictable. A gambler betting at the
roulette wheel for example, may have thousands of repeated experiences with the same event. And for each one, they get clear feedback in the form of whether they win or lose, but you would rightfully
not consider them an expert because the environment is low validity. A roulette wheel is essentially random, so there are no
regularities to be learned. In 2006, legendary investor, Warren Buffet offered to bet a million dollars that he could pick an investment that would outperform Wall
Street's best hedge funds over a 10 year period. Hedge funds are pools of money that are actively managed
by some of the brightest and most experienced
traders on Wall Street. They use advanced techniques
like short selling, leverage, and derivatives in an attempt to provide outsized returns. And consequently, they
charge significant fees. One person took Buffet up on the bet; Ted Seides of Protege Partners. For his investment, he
selected five hedge funds. Well actually, five funds of hedge funds. So in total, a collection of
over 200 individual funds. Warren Buffet took a
very different approach. He picked the most basic, boring investment imaginable; a passive index fund that just tracks the weighted value of the 500 biggest public companies in America, the S&P 500. They started the bet on January 1st, 2008, and immediately things did
not look good for Buffet. It was the start of the
global financial crisis, and the market tanked. But the hedge funds could
change their holdings and even profit from market falls. So they lost some value, but not as much as the market average. The hedge funds stayed ahead for the next three years, but by 2011, the S&P 500 had pulled even. And from then on, it wasn't even close. The market average surged leaving the hedge funds in the dust. After 10 years, Buffet's
index fund gained 125.8% to the hedge funds' 36%. Now the market performance was not unusual over this time. At eight and a half percent annual growth, it nearly matches the stock
market's long run average. So why did so many
investment professionals with years of industry experience, research at their fingertips, and big financial incentives to perform, fail to beat the market? Well because stocks are a
low validity environment. Over the short term, stock price movements are
almost entirely random. So the feedback, although
clear and immediate doesn't actually reflect anything about the quality of the decision making. It's closer to a roulette
wheel than to Chess. Over a 10 year period, around 80% of all actively
managed investment funds fail to beat the market average. And if you look at longer time periods, under performance rises to 90%. And before you say, "Well that means 10% of
managers have actual skill, consider that just through random chance, some people would beat the market anyway. Portfolios picked by
cats or throwing darts have been shown to do just that. And in addition to luck, there are nefarious practices from insider trading to
pump and dump schemes. Now I don't mean to say there
are no expert investors. Warren Buffet himself is a clear example. But the vast majority of stock pickers and active investment managers, do not demonstrate expert performance because of the low validity
of their environment. Brief side note, if we know that stock picking will usually yield worse
results over the long term, and that what active
managers charge in fees is rarely compensated for
in improved performance, then why is so much money invested in individual stocks, mutual funds, and hedge funds? Well let me answer that with a story. There was an experiment carried
out with rats and humans, where there's a red
button and a green button that can each light up. 80% of the time, the
green button lights up. And 20% of the time the
red button lights up, but randomly. So you can never be sure
which button will light. And the task for the subject, either rat or human, is to guess beforehand
which button will light up by pressing it. For the rat, if they guess right,
they get a bit of food. And if they guess wrong,
a mild electric shock. The rat quickly learns to
press only the green button and accept the 80% win percentage. Humans on the other hand, usually press the green button. But once in a while, they try to predict when
the red light will go on. And as a result, they guess
right only 68% of the time. We have a hard time
accepting average results. And we see patterns everywhere,
including in randomness. So we try to beat the average
by predicting the pattern. But when there is no pattern,
this is a terrible strategy. Even when there are patterns, you need timely feedback
in order to learn them. And YouTube knows this, which is why within the first hour after posting a video, they tell you how its performance compares to your last 10 videos. There's even confetti fireworks when the video is number one. I know it seems like a silly thing, but you have no idea how
powerful a reward this is and how much YouTuber effort is spent chasing this
supercharged dopamine hit. To understand the difference between immediate and delayed feedback, psychologist Daniel Kahneman contrasts the experiences of
anesthesiologists and radiologists. Anesthesiologists work
alongside the patient and get feedback straight away. Is the patient unconscious
with stable vital signs? With this immediate feedback, it's easier for them to learn the regularities of their environment. Radiologists, on the other hand, don't get rapid feedback
on their diagnoses if they get it at all. This makes it much harder
for them to improve. Radiologists typically correctly diagnose breast cancer from x-rays
just 70% of the time. Delayed feedback also
seems to be a problem for college admissions officers
and recruitment specialists. After admitting someone to college, or hiring someone at a big company, you may never, or only much
later find out how they did. This makes it harder to
recognize the patterns in ideal candidates. In one study, Richard Melton tried to predict the grades of freshmen at the end of their first year of college. A set of 14 counselors interviewed each student for 45 minutes to an hour. They also had access
to high school grades, several aptitude tests, and a four page personal statement. For comparison, Melton
created an algorithm that used as input, only a fraction of the information. Just high school grades
and one aptitude test. Nevertheless, the
formula was more accurate than 11 of the 14 counselors. Melton's study was reported alongside over a dozen similar results across a variety of other domains, from predicting who would violate parole to who'd succeed in pilot training. If you've ever been denied admission to an educational institution, or turned down for a job, it feels like an expert has
considered your potential and decided that you don't
have what it takes to succeed. I was rejected twice from film school and twice from a drama program. So it's comforting to know that the gatekeepers at these institutions aren't great predictors of future success. So if you're in a valid environment, and you get repeated experience
with the same events, with clear, timely
feedback from each attempt, will you definitely become an expert in 10,000 hours or so? The answer unfortunately is no. Because most of us want to be comfortable. For a lot of tasks in life, we can become competent in a
fairly short period of time. Take driving a car for example, initially it's pretty challenging. It takes up all of system two. Bu after 50 hours or so
it becomes automatic. System one takes over, and you can do it without
much conscious thought. After that, more time spent driving doesn't improve performance. If you wanted to keep improving, you would have to try driving
in challenging situations like new terrain, higher
speeds, or in difficult weather. Now I have played guitar for 25 years, but I'm not an expert because
I usually play the same songs. It's easier and more fun. But in order to learn, you have to be practicing
at the edge of your ability, pushing beyond your comfort zone. You have to use a lot of concentration and methodically repeatedly attempt things you aren't good at. - You can practice
everything exactly as it is and exactly as it's written, but at just such a speed that you have to think about and know exactly where you are and what your fingers are doing and what it feels like. - This is known as deliberate practice. And in many areas professionals don't engage
in deliberate practice, so their performance doesn't improve. In fact, sometimes it declines. If you're experiencing chest pain and you walk into a hospital, would you rather the
doctor is a recent graduate or someone with 20 years experience? Researchers have found that diagnostic skills of medical students increase with their
time in medical school, which makes sense. The more cases you've seen with feedback, the better you are at spotting patterns. But this only works up to a point. When it comes to rare diseases
of the heart or lungs, doctors with 20 years
experience were actually worse at diagnosing them than recent graduates. And that's because they
haven't thought about those rare diseases in a long time. So they're less able to
recognize the symptoms. Only after a refresher course, could doctors accurately
diagnose these diseases. And you can see the same effect in chess. The best predictor of skill level, is not the number of games
or tournaments played, but the number of hours dedicated to serious solitary study. Players spend thousands of hours alone learning chess theory, studying their own games
and those of others. And they play through compositions, which are puzzles designed to help you recognize tactical patterns. In chess, as in other areas, it can be challenging to force yourself to practice deliberately. And this is why coaches and
teachers are so valuable. They can recognize your weaknesses and assign tasks to address them. To become an expert, you have to practice
for thousands of hours in the uncomfortable zone, attempting the things
you can't do quite yet. True expertise is amazing to watch. To me, it looks like magic, but it isn't. At its core, expertise is recognition. And recognition comes
from the incredible amount of highly structured information stored in long-term memory. To build that memory,
requires four things: a valid environment, many
repetitions, timely feedback, and thousands of hours
of deliberate practice. When those criteria are met, human performance is astonishing. And when it's not, you get people we think of as experts who actually aren't. (techno sound) If you want to become a STEM expert, you have to actively
interact with problems. And that's what you can do with Brilliant, the sponsor of this video. Check out this course on computer science, where you can uncover the optimal strategy for finding a key in a room. And you quickly learn how your own strategy can be
replicated in a neural network. Logic is another great course that I find challenges me mentally. You go from thinking
you understand something to actually getting it. And if it feels difficult,
that's a good thing. It means you're getting pushed
outside your comfort zone. This is how Brilliant
facilitates deliberate practice. And if you ever get stuck, a helpful hint is always close at hand. So don't fall into the trap
of just getting comfortable in doing what you know how to do. Build in the habit of being uncomfortable, and regularly learning something new. That is the way to lifelong
learning and growth. So I invite you to check out the courses over at Brilliant.org/veritasium, and I bet you will find something there that you wanna learn. Plus if you click through right now, Brilliant are offering 20% off an annual premium subscription to the first 200 people to sign up. So I wanna thank Brilliant
for supporting Veritasium, and I wanna thank you for watching.
If China is destined to collapse, why launch a trade war?
16:30 Here is the summary for those with little time 1. Valid Environment 2. Many repetitions 3. Timely feedback 4. Deliberate Practice
In US, they are just public manipulation experts. The entire political system is designed to allow the art of scamming people to reach expert level.
“It is difficult to get a man to understand something, when his salary depends on his not understanding it.”
― Upton Sinclair