Why do trading strategies stop working?

Often because they never worked: the backtest fitted noise. Others decay as markets change or as the edge is traded away.

How can I tell if a backtest is overfitted?

Test it out of sample, count how many variations were tried, deflate its Sharpe ratio for that count, and see whether it survives small parameter changes.

Is a longer backtest safer?

It helps, but not if many strategies were tried on it. The number of trials matters as much as the length of history.

Learn · Backtest overfitting

Why do backtests fail live? Backtest overfitting explained

Reviewed against the platform's code on Sep 23, 2026

Backtest overfitting happens when a strategy's rules or parameters are tuned — deliberately or through repeated trial — to the noise of a particular history, so the backtest looks strong but the edge does not exist out of sample and live performance decays.

Why it matters

It is the most common reason backtested strategies fail in live trading. The more variations tried, the more likely the best one is a statistical accident — and the more convincing its backtest looks.

How it works

It is detected by testing out of sample (walk-forward, purged cross-validation), by correcting performance statistics for the number of trials (the deflated Sharpe ratio), by estimating the probability of backtest overfitting, and by checking that results survive small changes to parameters.

How Opulence Alpha applies it

Opulence Alpha's publication gate requires the number of trials the search actually ran, estimates the probability of backtest overfitting, runs a reality check for data snooping, and refuses to publish a strategy whose optimised parameters do not survive being rounded to a simpler grid.

The Promotion Gate →

Related concepts

Deflated Sharpe ratioThe deflated Sharpe ratio adjusts a strategy's Sharpe ratio for the number of strategies tried and for non-normal returns, giving the probability that its true Sharpe ratio is above zero.Multiple testingMultiple testing (data snooping) is what happens when many strategies are tested on the same data: some will look significant by chance. How reality checks and step-down tests correct for it.Walk-forward validationWalk-forward validation tests a strategy the way it would have been used: fit on the past only, test on the next unseen period, then roll forward and repeat.

All concepts →Sector behaviour in every market regime →

Questions

Why do trading strategies stop working?: Often because they never worked: the backtest fitted noise. Others decay as markets change or as the edge is traded away.
How can I tell if a backtest is overfitted?: Test it out of sample, count how many variations were tried, deflate its Sharpe ratio for that count, and see whether it survives small parameter changes.
Is a longer backtest safer?: It helps, but not if many strategies were tried on it. The number of trials matters as much as the length of history.

References

Bailey, D., Borwein, J., López de Prado, M. & Zhu, Q. (2017). The Probability of Backtest Overfitting. Journal of Computational Finance.
Harvey, C., Liu, Y. & Zhu, H. (2016). …and the Cross-Section of Expected Returns. Review of Financial Studies.

Educational content about research methods. Not investment advice.