← All articles
Dataset forensics

Survivorship bias in memecoin data: what 475,000 alerts taught us

2026-08-016 min readTrading Bot House

Every memecoin influencer's track record, every signal group's "90% win rate", every viral backtest thread shares one property: the dataset only contains tokens that lived long enough to be counted. We run a scanner that logs every alert it fires — 475,000+ and counting — at the moment of firing, with live market data, before knowing anything about the future. That design choice is the whole difference between real numbers and marketing. Here's what the unfiltered data says.

The honest base rates
Alerts logged, all detectors
475K+
every alert, at fire time
Ever reach 2x after alert
5.2%
baseline across everything
Best gated subset we found
15.2%
6+ detectors, age 6h–14d
Survivorship inflation
+30pp
when dead tokens drop out
Where the bodies go missing

Survivorship in memecoin data isn't one bug — it's a pipeline of disappearances, each removing losers before anyone counts:

Why memecoins are the worst case

Survivorship exists everywhere, but memecoins maximize it: token lifetimes are measured in hours, the death rate is extreme, and the winners are so loud that a 5% hit rate can fund an entire ecosystem of screenshots. When we studied exits, we found the median rug goes to zero faster than a human can react to an alert — which is why our research concluded that on-chain memecoin edges live in entry selection, not exit tactics. No stop-loss saves you from a contract that blocks selling.

If a dataset can't show you the tokens that went to zero, every percentage computed from it is fiction with confidence intervals. — rule zero of our outcome tracker
How to spot survivorship-free numbers

This is the standard we hold our own public track record to, and the same logged-at-fire-time data now powers the memecoin mode of the backtest Studio — so when you test an entry filter, the rugs are in your denominator too.

Run your strategy through the same engine

Describe it in plain English. The AI compiles it; the anti-bias engine tests it on up to 3 years of real data and shows the warnings before the profit. Free to start.

Test a strategy free → See famous strategies fail