Skip to main content

Quant Analytics: from scratch to pro · Backtesting done right · Pro

Reading a backtest report: expectancy, win rate, profit factor and their traps

A backtest report is a set of summary numbers, each of which can mislead alone. Win rate and payoff only mean something together as expectancy. Profit factor, Sharpe ratio and trade count each need an uncertainty attached. This lesson shows how to read them and how to ask how long a record must be.

4 min read Reviewed Revision 1

In this lesson

  • Compute expectancy in R from a win rate and a payoff ratio
  • Compute profit factor and the break-even win rate for a payoff
  • Attach a standard error to expectancy and say how many trades are enough
  • Compute a probabilistic Sharpe ratio and a minimum track record length

Read first: Overfitting, trial counts and the deflated Sharpe ratio, Walk-forward, out-of-sample and the locked holdout, Risk-adjusted return: the Sharpe and Sortino ratios

Worked numbers

Each result is recomputed from the formula shown.

WhatFormulaResult
win rate0.440%
average winner in R2.52.5R
expectancy per trade in Rp_win * w_r - (1 - p_win) * 10.40R
profit factor(p_win * w_r) / ((1 - p_win) * 1)1.67
break-even win rate for a payoff of 2.51 / (1 + w_r)28.6%
expectancy of a 90% win rate rule0.9 * 0.2 - 0.1 * 2.50.07R
its profit factor(0.9 * 0.2) / (0.1 * 2.5)0.72
standard deviation of the result per tradesqrt(p_win * (w_r - expect)**2 + (1 - p_win) * (-1 - expect)**2)1.71R
standard error of expectancy over 50 tradessd_r / sqrt(50)0.24R
t-statistic with 50 tradesexpect / se501.65
t-statistic with 100 tradesexpect / (sd_r / sqrt(100))2.33
trades for a t-statistic of 2(2 * sd_r / expect)**274 trades
daily Sharpe ratio0.080.08
the same, annualisedsr_d * sqrt(252)1.27
adjustment for skew -1 and kurtosis 6sqrt(1 - (-1) * sr_d + (6 - 1) / 4 * sr_d**2)1.043
probabilistic Sharpe z-scoresr_d * sqrt(500 - 1) / adj61.71
probabilistic Sharpe ratio against zerophi(z_psr6)95.7%
minimum track record length, 95% confidence, benchmark zero1 + adj6**2 * (phi_inv(0.95) / sr_d)**2461

Check yourself

A rule wins 40% of its trades. Winners average 2.5R and losers lose 1R. What is the expectancy per trade?

0.4 x 2.5 - 0.6 x 1 = 0.40R. Each trade is expected to add 0.4 times the amount risked.

A rule wins 90% of the time, with winners of 0.2R and losers of 2.5R. Is that a good record?

No. Expectancy is 0.9 x 0.2 - 0.1 x 2.5 = a loss of 0.07R per trade, and the profit factor is 0.72. A high win rate says nothing alone.

What win rate is needed to break even when winners are 2.5 times the losers?

1 / (1 + 2.5) = 28.6%. Below it the rule loses before costs, above it the rule gains.

The 0.40R rule has a per-trade standard deviation of 1.71R. How many trades give a t-statistic of 2?

n = (2 x 1.71 / 0.40)^2 = 74 trades. With 50 trades the t-statistic is 1.65.

A daily Sharpe ratio of 0.08 over 500 days, skew -1, kurtosis 6. What is the probability that the true Sharpe is above zero?

The adjustment is 1.043, the z-score is 0.08 x sqrt(499) / 1.043 = 1.71, and the probabilistic Sharpe ratio is 95.7%.

Key terms

ExpectancyWin rateProfit factorDeflated Sharpe ratio

Sources

Informational content. Not investment advice.