Skip to main content

Quant Analytics: from scratch to pro · Statistics for markets · Pro

Bootstrap and robust statistics for heavy-tailed data

Market returns have fat tails and some serial dependence, which breaks the textbook formulas for standard errors. The bootstrap rebuilds the sampling distribution from the data itself, the block bootstrap respects dependence, and robust statistics such as the median and MAD limit the damage from outliers.

4 min read Reviewed Revision 1

In this lesson

  • Run an i.i.d. bootstrap and a block bootstrap and say when each is appropriate
  • Build a percentile confidence interval from bootstrap replicates
  • Compute a robust scale estimate with MAD x 1.4826
  • Choose between mean, median and winsorised statistics on data with outliers

Read first: How sure is an average? Standard error and confidence intervals, Hypothesis tests and p-values for market data, Return distributions and fat tails

Worked numbers

Each result is recomputed from the formula shown.

WhatFormulaResult
sample standard deviation of 20 daily returns, percent1.40409
textbook standard error of the meansd20 / sqrt(20)0.314
exact i.i.d. bootstrap standard error of the meansd20 * sqrt(19 / 20) / sqrt(20)0.306
MAD of 0.30 on the standard deviation scale0.30 * (1 / phi_inv(0.75))0.445
MAD scale constant1 / phi_inv(0.75)1.4826
relative efficiency of the median on normal data2 / pi64%
median standard error relative to the mean'ssqrt(pi / 2)1.25
standard error inflation with autocorrelation 0.1sqrt((1 + 0.1) / (1 - 0.1)) - 110.6%
block length of order n^(1/3) for 2,520 days2520 ** (1 / 3)14

Check yourself

Why is MAD multiplied by 1.4826 to estimate a standard deviation?

For normal data the MAD equals 0.6745 standard deviations (the 75th percentile of the standard normal). Dividing by 0.6745, which is multiplying by 1.4826, puts it on the same scale as the standard deviation.

Twenty daily returns include one of -6%. The mean is -0.21% and the median is +0.10%. Which describes a typical day?

The median. One outlier moves the mean by about 0.3 points (the other 19 days have a mean of 0.09%); it moves the median not at all.

Why does the i.i.d. bootstrap understate uncertainty on daily returns with positive autocorrelation?

It shuffles observations and so destroys the dependence. With autocorrelation 0.1 the true standard error of a mean is about 10% larger than the i.i.d. figure.

What does a block bootstrap do differently?

It resamples consecutive stretches of data, so within a block the order and dependence are preserved. Block length trades bias against variance.

What is the cost of using the median instead of the mean on normal data?

Efficiency. The median's standard error is about 1.25 times that of the mean (2/pi = 64% of the information).

Key terms

BootstrapStandard errorConfidence intervalStandard deviation

Sources

Informational content. Not investment advice.