survivorship bias
-
What is survivorship bias?
Survivorship bias is a logical error where focus is placed only on things that have survived some process, overlooking those that did not. This can lead to incorrect conclusions because the successes receive more attention than the failures, intentionally or unintentionally suppressing some evidence to highlight other evidence.
This bias appears across many domains. For example, in finance, attention is often directed toward successful companies while ignoring those that failed. Similarly, some people might continue harmful habits because they haven't experienced negative consequences, influenced by others who succeeded despite the risks.
In experimental design, survivorship bias can occur when comparing early and later observations if participants drop out, skewing results. During World War II, military analyst Abraham Wald famously noted that damage to returning aircraft indicated where additional armor was not needed, since those planes survived; instead, he suggested reinforcing the areas with the least damage, as those were likely the areas that brought down the planes that did not return.
1 Britannica SourceCreated from Britannica articles using AI. AI can make mistakes, so verify using Britannica articles. -
Why do people focus more on successes than failures?
People focus more on successes than failures due to survivorship bias, a logical error where attention is paid to entities that have 'survived' a selective filter, leading to incorrect conclusions. It's a cognitive bias, often unintentional, where successes get more attention than failures.
In finance, successful companies and individuals are highlighted, while failures are ignored. This creates misperceptions, like undervaluing college education because attention is given to wealthy tech entrepreneurs who dropped out. Similarly, people may take unwise risks influenced by the success of others who survived those risks. This bias affects experimental design, where only those planes that survived combat and returned were considered.
1 Britannica SourceCreated from Britannica articles using AI. AI can make mistakes, so verify using Britannica articles. -
How can survivorship bias lead to wrong conclusions?
Survivorship bias is a logical error where focus is placed only on things that have survived some process, which can lead to wrong conclusions. It occurs when successes get more attention than failures, often unintentionally.
For example, during World War II, military analysts only studied the aircraft that returned safely from combat, and they saw that these planes had taken the most damage to the wings, tail, and center of the body. They wanted to add armor to those areas; however, mathematician Abraham Wald noted that they were only considering the planes that survived. He recommended that the military add armor to the portions on the returning aircraft that bore the least damage, because he assumed that the downed planes took fatal hits in other areas.
Paying too much attention to successful companies and people, while ignoring those that failed, can lead to misperceptions.
1 Britannica SourceCreated from Britannica articles using AI. AI can make mistakes, so verify using Britannica articles. -
What is an example of survivorship bias in everyday life?
Survivorship bias is a logical error where attention is focused only on things that have survived some process, leading to incorrect conclusions.
An example of this bias in everyday life can be seen in how people view college dropouts who become successful tech entrepreneurs. The media often highlights these individuals, creating the perception that a college education is unnecessary for a tech career. However, the vast majority of college dropouts do not achieve such success, and ignoring their experiences can undervalue the importance of a college degree.
1 Britannica SourceCreated from Britannica articles using AI. AI can make mistakes, so verify using Britannica articles. -
How does survivorship bias affect scientific studies or data analysis?
Survivorship bias is a logical error where focus is placed only on things that have survived a selective process, leading to incorrect conclusions. It's a type of sampling bias where observations at the end of a study aren't a random subset of initial observations.
In experimental design, survivorship bias can occur when comparing early and later observations or control and treatment groups. For instance, a study during the COVID-19 pandemic in the U.K. saw anxiety and depression levels appear to decline over time, but this was because those experiencing symptoms were less likely to complete follow-up surveys.
A famous example involved analyzing Allied military aircraft damage during World War II. The military wanted to reinforce areas with heavy damage on returning planes. However, mathematician Abraham Wald noted that they should reinforce areas without much damage, because planes shot down likely took fatal hits in those areas.
1 Britannica SourceCreated from Britannica articles using AI. AI can make mistakes, so verify using Britannica articles. -
What are ways to avoid or reduce survivorship bias when making decisions?
Survivorship bias is a logical error where focus is placed only on things that have survived some process, which can lead to incorrect conclusions. It occurs when successes attract more attention than failures, often unintentionally.
To avoid survivorship bias:
* Consider failures as well as successes to get a full picture.
* Recognize that visible successes may not represent the entire group.
* Be wary of generalizing from a small sample of successful cases.
* When assessing risk, consider both those who survived it and those who didn't.
* Use statistical techniques and improved study design to correct for it.2 Britannica SourcesCreated from Britannica articles using AI. AI can make mistakes, so verify using Britannica articles.
survivorship bias, a logical error in which attention is paid only to those entities that have passed through (or “survived”) a selective filter, which often leads to incorrect conclusions. In statistics, survivorship bias can be defined as a form of sampling bias in which the observations taken at the end of a period of study do not conform to the random subset of the observations made at the beginning of the study. It is commonly identified as a concern in experimental design, and more broadly in science as a whole; however, it can also influence personal decision making and the choices made in areas of public policy, business, and other domains.
Outside of controlled studies, survivorship bias occurs as a kind of cognitive bias in which successes tend to garner more attention than failures. It may be described as a form of cherry-picking (that is, a logical fallacy in which some evidence is suppressed so that other evidence can be highlighted), though usually it is unintentional and even unconscious.
Survivorship bias in experimental design
Survivorship bias is a common problem in experimental design, and it may appear when early observations are compared with later ones or between control groups and treatment groups. For example, a large-scale longitudinal study examining the effects of the coronavirus pandemic in the United Kingdom in 2020 noted that the higher levels of anxiety and depression among surveyed U.K. residents that occurred during the initial month of the pandemic-related quarantines (April 2020) appeared to decline when those people were surveyed again in subsequent months. The results of the completed study appeared to show that symptoms of anxiety and depression had fallen among U.K. residents as the pandemic continued; however, researchers noted that some 40 percent of people who took the first survey did not complete follow-up surveys. It was shown later that respondents who were experiencing symptoms of anxiety and depression at the time were less likely to complete subsequent surveys, and so the data sets of later surveys were made up of a greater share of respondents who were experiencing fewer or no symptoms.
Perhaps the most famous example of survivorship bias occurred in the analysis of Allied military aircraft that returned from combat missions during World War II. A study of returning planes showed that many had taken heavy damage to the wings, the tail, and the centre of the body. The military initially planned to add armour to those areas to prevent damage; however, Columbia University mathematician Abraham Wald, who was hired to assist with the study, noted that this approach was backward, since the military was only considering those planes that survived combat and returned. In essence, military analysts were only focusing on those parts of the planes where damage was not fatal during the mission. Wald made the assumption that downed planes took fatal hits in other areas, and he recommended that the military add armour to the portions on the returning aircraft that bore the least damage.
While researchers often attempt to correct for survivorship bias by applying statistical techniques and improved design and analysis, after a study is completed, the process of publishing the study’s findings may suffer from a kind of survivorship bias termed publication bias. There is increasing concern in the sciences that many published research findings are false due in part to the effects of publication bias—that is, the tendency of research journals to publish interesting results. Interesting results that occur in studies are often those that show evidence of a relationship between one phenomenon and another, such as when one variable triggers or influences another variable to some degree. In contrast, those studies that show no evidence of a relationship between phenomena are more often left out of the journal.
Survivorship bias in other areas
The same problem is common across domains. In finance, inordinate attention is paid to successful companies and individuals, and the companies and individuals that fail usually receive less attention in the news media. For example, much attention is paid to several wealthy and famous tech entrepreneurs who left college before completing their degrees, which may create a perception that a college education is unhelpful when starting a tech career. However, in reality, the great majority of college dropouts do not go on to become wealthy, and ignoring those people can lead to misperceptions that undervalue the usefulness of a college degree in building wealth. Studying only the top performers in a given domain (such as hedge fund management, entertainment, and sports) can lead to systematic misperceptions about the efficacy of those performers’ strategies.
Survivorship bias can play a role in our daily lives. People may be reluctant to avoid making harmful choices or engaging in detrimental strategies or habits because of their personal experience with them. For example, if a playground toy is associated with a high risk of injury, community officials may resist removing it from a local playground because children in their community have never been injured by it and thus they have concluded that the toy is safe. In addition, people may also take unwise risks because they are influenced by the success of others who survived such risks and were not exposed to the hardship caused by those risks; efforts to emulate these people can hamper one’s ability to learn from those who did not succeed.

" height="20" alt="HEW Logo">