Mini Rant:

Every founder loves their analytics dashboard. “Look at our active users!” “Check out this retention curve!” “Our NPS is through the roof!”

Six months later: growth is still flat. Acquisition costs keep rising. Conversion rates haven’t budged. The company is still proudly waving reports from the same happy users.

But you’re only seeing part of the story—the planes that made it back to base.

You’re blind to the ones that crashed and burned.

✈️ The Missing Planes Insight:

During WWII, engineers studying returning fighter planes recommended reinforcing the areas most often riddled with bullet holes.

But statistician Abraham Wald flipped the script: don’t armor where the bullets are—armor where they’re not. The planes that came back were the lucky ones. The others? Shot down where it really mattered.

The areas without damage on returning planes weren’t stronger—they were critical failure points. When hit there, planes didn’t return to be counted.

Wald recognized what others missed: the dataset was incomplete. He was looking at survivors, not casualties.

📊 The Analytics Trap:

Alex builds a SaaS tool. Checks the analytics religiously: power users love feature X. They use it daily. The support team gets rave reviews about it.

“Feature X is our killer feature!” Alex tells investors. “Let’s double down on it.”

Reality: 90% of users who try feature X once never return to the product. But Alex never sees this data because he’s only studying users who stuck around—the survivors who made it past the critical failure points.

He’s reinforcing the parts of the plane that can already take bullets.

✈️ Signs You’re Optimizing Bullet Holes:

  • You focus on improving features your power users love
  • Your roadmap is built on feedback from your most active customers
  • You analyze completed flows more than abandoned ones
  • Your understanding of churn comes from exit surveys (from people who bothered to fill them out)
  • You’re confused why feature improvements don’t move your overall metrics

🔍 The Silent Majority Problem:

Most founders still haven’t learned Wald’s lesson.

They optimize based on what they see: active users, successful flows, loud feedback. But they ignore the users who don’t show up. The signups that never activated. The ones who bounced silently.

The dead don’t fill out surveys. The confused don’t submit bug reports. The overwhelmed don’t reach out to support.

They just… disappear.

Your data is lying to you. Survivors are loud. The dead are quiet.

📈 The Truth About Your Data:

Your metrics are a highlight reel of people who already “get” your product.

They survived your onboarding. They navigated your confusing UI. They pushed past the bugs and missing features because something about your product was valuable enough to overcome the friction.

They’re outliers. Optimizing for them is like designing a classroom only for A+ students.

The real growth opportunity isn’t making your best users 10% happier. It’s making the 80% who bounced give you a second chance.

⚠️ Warning: You Have Survivorship Bias When:

  • Most of your product decisions come from user interviews with current customers
  • You spend more time on new features than fixing onboarding drop-offs
  • You can’t explain why your impressive engagement metrics don’t translate to growth
  • You dismiss negative feedback as “not our target user”
  • Your roadmap prioritizes depth for power users over accessibility for new users

Want better onboarding? Don’t watch who finished—watch who bailed. Want tighter retention? Stop reading NPS from your fans. Study the drop-off before week 1.

🎯 The Anti-Survivorship Framework

  • Track silent failures, not just loud successesWhat are the exit points no one talks about?
  • Interview the almost-customers, not just customersPeople who evaluated but didn’t buy
  • Analyze first-session bounces religiouslyThey’re telling you something without words
  • Test with fresh eyes, not trained usersYour team and power users are terrible test subjects
  • Fix deadly friction before optimizing successful flowsPatch the cockpit before reinforcing the wings

🔄 Where to Look Instead:

Instead of: Analytics on completed onboardingLook at: Drop-off points in the first 2 minutesInstead of: Feature usage from power usersLook at: Features attempted once but never againInstead of: Support tickets (from people who cared enough to ask)Look at: Session recordings of users who never came backInstead of: Churn reasons from exit surveysLook at: Behavior patterns in the 14 days before silent churnInstead of: NPS from longtime usersLook at: The features new signups try to find but can’t

🔍 How to Find Your Missing Planes:

  • Run “first 5 minutes” tests with people who match your target but have never seen your product
  • Implement exit-intent surveys on key pages (catch them before they bounce)
  • Create a “zombie segment” of users who signed up but never activated, and target them for research
  • Analyze the “almost-converted” — people who got 90% through your funnel but dropped off
  • Set up automatic session recordings focused exclusively on one-time visitors

Founders love dashboards, funnels, feedback. But those are just the bullet holes on the wings.

The missing planes tell the real story.

Don’t just optimize what works. Find what’s silently killing your product before users ever have a chance to become statistics in your analytics.

Your best product insights aren’t in your dashboard. They’re in the silence of people who left without a word.

This week’s action:

Create a “Missing Planes Report.” Identify the three largest drop-off points in your user journey where people disappear without feedback.

For each point, brainstorm what might be happening and design a specific way to capture data from these users before they vanish.

Stop optimizing for the survivors until you understand what’s killing the rest.

Are you only seeing the planes that made it back?

I’ll help you uncover the critical failure points your analytics dashboard isn’t showing you. 🔍Book a teardown