BacktestScore

Monte Carlo simulation for trading strategies, and what the range doesn't tell you

A single equity curve is one path through history. Monte Carlo simulation shows the other paths the same trades could have taken, which is useful for sizing expectations and nearly useless on its own for telling a real edge from a lucky one.

What is Monte Carlo simulation in backtesting?

Monte Carlo simulation in backtesting reshuffles or resamples a strategy's own trade sequence, then re-runs the equity curve thousands of times to show the range of outcomes the same edge could have produced by chance alone. It measures how much of a result depends on trade order rather than the edge itself.

The inputs are usually the trade list a backtest already produced: the sequence of wins and losses, or the daily return series. Reshuffling that sequence, or drawing from it with replacement, and replotting the equity curve each time turns one line into a distribution of lines, typically summarised as a percentile band around the original.

Is Monte Carlo simulation the same as walk-forward testing?

No. Walk-forward tests whether a rule holds up on data it was not tuned on, moving forward through calendar time. Monte Carlo instead reshuffles trades a strategy already produced to size how much of the equity curve was sequence luck. The two answer different questions and neither substitutes for the other.

A strategy can pass walk-forward cleanly and still owe most of its headline drawdown figure to one unlucky ordering of trades, and a strategy can show a tight Monte Carlo band while still being tuned to noise, because resampling the same 40 in-sample trades a thousand times never tests whether those 40 trades were the right 40 to trust. Seewalk-forward vs CPCVandin-sample vs out-of-samplefor what each structural test actually proves.

Which platforms actually run it

Crossing two assessed fields that have never been crossed on this site before: whether a platform runs Monte Carlo resampling of trades or the equity curve at all, and whether it pairs that resampled distribution with a deflated or probabilistic Sharpe, or a formal overfitting metric, so a reader gets a significance read rather than a chart to eyeball.

PlatformMonte CarloValidation score
Minerva*Resampling, paired with a significance read9.5
StrategyQuant XResampling only, no paired significance test6.5
TradeStationResampling only, no paired significance test6.5
Wealth-LabResampling only, no paired significance test6.5
AmiBrokerResampling only, no paired significance test6.0
NinjaTraderResampling only, no paired significance test6.0
VectorBTNo Monte Carlo resampling8.5
QuantConnectNo Monte Carlo resampling5.5
QuantRocketNo Monte Carlo resampling5.0
FreqtradeNo Monte Carlo resampling4.5
MetaTrader 5No Monte Carlo resampling4.0
Backtesting.pyNo Monte Carlo resampling3.5
TrendSpiderNo Monte Carlo resampling3.5
ComposerNo Monte Carlo resampling3.0
Forex TesterNo Monte Carlo resampling3.0
BacktraderNo Monte Carlo resampling2.5
Trade IdeasNo Monte Carlo resampling2.5
NautilusTraderNo Monte Carlo resampling2.0
TradingViewNo Monte Carlo resampling2.0
Zipline ReloadedNo Monte Carlo resampling2.0

* Commercial relationship with this site, scored on the same published rubric as every other platform. Disclosure

The finding

Of the 20 platforms assessed, 6 run genuine Monte Carlo resampling: Minerva, AmiBroker, NinjaTrader, StrategyQuant X, TradeStation, Wealth-Lab. Of those, only one, Minerva pairs the resampled distribution with a deflated or probabilistic Sharpe or a formal overfitting metric. The other 5 produce a range with nothing built in to say whether the original backtest sits inside it comfortably or out near the unlucky tail, leaving that judgement entirely to the reader.

Assessed from vendor documentation and, where public, installed source, on ourpublished rubric.

What doesn't a Monte Carlo result tell you?

A Monte Carlo result does not tell you whether the strategy was fit to noise in the first place, because it only resamples the trades that survived selection, never tests the trades that were tried and discarded, and says nothing about whether the original rule was the right one to keep out of everything else attempted.

  1. It does not correct for the number of variants tried.Reshuffling the winning rule's trades a thousand times says nothing about the rules that were tried and discarded first. Seeprobability of backtest overfittingfor the test that does.
  2. It does not detect a leak. If the underlying trade list was produced with look-ahead bias or an unrealistic fill model, resampling that list faithfully reproduces the leak in every path. Seelook-ahead biasandexecution realism.
  3. A tight band is not proof of skill. A strategy with very few trades can show a deceptively tight resampled range simply because there is little to reshuffle, which is the opposite of what a tight band is usually read to mean.
  4. Reshuffling and block bootstrapping are not interchangeable.Plain reshuffling assumes trades are independent; returns with autocorrelation or regime clustering need a block bootstrap that preserves runs, or the resampled range understates how correlated real drawdowns can get.

Frequently asked questions

What is Monte Carlo simulation in backtesting?

Monte Carlo simulation in backtesting reshuffles or resamples a strategy's own trade sequence, then re-runs the equity curve thousands of times to show the range of outcomes the same edge could have produced by chance alone. It measures how much of a result depends on trade order rather than the edge itself.

Is Monte Carlo simulation the same as walk-forward testing?

No. Walk-forward tests whether a rule holds up on data it was not tuned on, moving forward through calendar time. Monte Carlo instead reshuffles trades a strategy already produced to size how much of the equity curve was sequence luck. The two answer different questions and neither substitutes for the other.

Does a wide Monte Carlo range mean a strategy is bad?

Not by itself. A wide range means the result is sensitive to trade order, which is common for strategies with few trades or lumpy win sizes. It becomes a problem only when the range is so wide that the observed backtest sits near the unlucky tail, which a paired significance test is what actually tells you.

Which platforms run genuine Monte Carlo simulation?

6 of the 20 platforms assessed here: Minerva, AmiBroker, NinjaTrader, StrategyQuant X, TradeStation, Wealth-Lab. Of those, only one pair the resampled distribution with a deflated or probabilistic Sharpe, or a formal overfitting metric, rather than leaving the reader to eyeball the spread.

Can I run a Monte Carlo test without the platform supporting it?

Yes. Export the trade list, resample the sequence with replacement several thousand times in a spreadsheet or a short script, and plot the resulting equity curves. The statistics are simple; what a built-in feature saves is the plumbing, not the math.

Related

Educational content only, not investment advice. The scores above describe published and installed-source engine behaviour and are not a judgement on any specific strategy.