cognitive biasstrategydata literacy

Survivorship Bias Is Eating Your Strategy Alive

/ 4 min read / C. Pearson

During World War II, the US military studied bombers returning from combat to figure out where to add armor. The damage was concentrated on the fuselage and wings, so the obvious recommendation was to reinforce those areas. Obvious, and completely wrong.

Vintage military aircraft in formation

Mathematician Abraham Wald pointed out the flaw: they were only studying planes that came back. The planes hit in the engines and cockpit didn't return. The visible damage showed where planes could survive getting hit, not where they were vulnerable.

This story gets retold constantly. People nod along. Then they go back to their desks and commit the exact same error in every strategic decision they make.

The Startup Graveyard You Never Visit

Read any business book, any founder interview, any "lessons from successful entrepreneurs" thread, and you'll get a recipe: drop out of college, move fast and break things, raise aggressively, follow your passion.

This is survivorship bias in its purest form. You're hearing from the 0.1% who made it. The other 99.9% who followed the same playbook and failed aren't writing books. They're not on podcasts. They don't exist in your dataset.

The actual base rate for venture-backed startups reaching a successful exit is around 10-20%, depending on your definition of success. For bootstrapped startups, most estimates put survival past five years below 50%. "Follow your passion and take risks" is advice that only looks smart because you never see the body count.

Investment Strategy, Built on Ghosts

Mutual fund advertising is a masterclass in survivorship bias. Funds with strong track records get marketed aggressively. Funds with weak track records get quietly merged or closed — and their performance data vanishes from the indexes.

This means the "average mutual fund return" you see reported is biased upward, because it only includes funds that survived long enough to be measured. Studies accounting for survivorship bias consistently find that the gap between reported and actual average performance is 1-2% annually. Over a career of investing, that phantom percentage point compounds into a massive distortion of expected returns.

The same applies to stock indexes. The S&P 500 regularly drops failing companies and adds successful ones. When someone shows you a chart of the S&P 500's long-term growth, you're looking at a continuously curated portfolio of winners, not a fixed basket of stocks. The companies that went to zero were quietly removed. The index doesn't remember them. Neither do you.

The Fix: Count the Dead

Good strategy requires studying failure at least as carefully as success. This is uncomfortable, because failure data is hard to get, depressing to analyze, and doesn't make for inspiring conference talks.

In business: Before emulating a successful company's strategy, find ten companies that tried the same strategy and failed. What differed? If you can't find the failures, that itself is a red flag — it means your data has a survivorship filter.

In investing: Demand backtest results that include delisted securities, closed funds, and dead strategies. Any backtest that only includes currently-surviving instruments is lying to you.

In hiring: "All our successful employees came from top universities" might just mean you only hire from top universities. You have no data on what would have happened with different candidates. Your sample is your filter.

In product: "Our power users all discovered Feature X" tells you nothing unless you also know how many users discovered Feature X and still churned.

The hardest part of survivorship bias isn't understanding it. Everyone understands it after the airplane story. The hardest part is recognizing it in your own data, where the missing observations are invisible by definition.

Every dataset is a dataset of survivors. The question is whether you remembered to ask who didn't make it.

SELECT * FROM outcomes WHERE survived = TRUE is not the query you think it is.

Get Mean Methods in your inbox

New posts delivered directly. No spam.

No spam. Unsubscribe anytime.

Related Reading