Lesson 5 of 8 · All lessons in this module
  1. Populations, samples and sampling error
  2. Stratified and cluster sampling
  3. Convenience and judgmental sampling, and choosing a method
  4. Sample size and mixing populations
  5. The central limit theorem
  6. The standard error of the sample meanVideo lesson
  7. Confidence intervals for the mean
  8. Bootstrap and jackknife resampling

Free lesson: the first lesson of every module is open to everyone.

Lesson 5 of 8 · 13 min

The central limit theorem

Whatever the shape of the population, the mean of a large random sample is approximately normally distributed around the true mean, with variance σ2/n\sigma^2/n.

In short

  • Central limit theorem (CLT): for any population with mean μ\mu and finite variance σ2\sigma^2, the sampling distribution of Xˉ\bar X from random samples of size nn is approximately normal with mean μ\mu and variance σ2/n\sigma^2/n when nn is large.
  • Three properties: approximately normal shape; mean equal to the population mean; variance equal to the population variance divided by nn.
  • Rule of thumb: n≥30n \ge 30 is large enough. A very non-normal population may need a sample well above 30.
  • The population does not have to be normal. The CLT is about the sample mean, not about individual observations.
  • Why it matters: it lets us make probability statements about μ\mu, build confidence intervals and test hypotheses even when the population's distribution is unknown or non-normal.

The sample mean has its own distribution

Draw a random sample of daily returns and compute its mean. Draw another sample of the same size and you get a slightly different mean. Repeat many times and plot all the means: that histogram is the sampling distribution of the sample mean.

Now run the experiment with samples of 10, then 50, then 100, then 300 daily returns. Two things happen as the sample size grows. The histogram looks more and more like a bell-shaped normal curve, and it becomes narrower, clustering tightly around the true mean.

In other words, large samples rarely produce a mean far from μ\mu, and the shape of their sampling distribution becomes predictable. The central limit theorem states this result precisely.

0246-1%-0.5%0%0.5%1%Sample mean daily returnDensityμ = 0.04%n = 10n = 50n = 100n = 300
Sampling distributions of Xˉ\bar X for daily returns with μ=0.04%\mu = 0.04\% and σ=1.2%\sigma = 1.2\%. All are centred on μ\mu, but the spread σ/n\sigma/\sqrt{n} shrinks from 0.38% at n = 10 to 0.07% at n = 300, so a mean far from μ\mu becomes rare.

The theorem and its three properties

Central limit theorem: take a population described by any probability distribution with mean μ\mu and finite variance σ2\sigma^2. The sampling distribution of the sample mean Xˉ\bar X, computed from random samples of size nn, will be approximately normal with mean μ\mu and variance σ2/n\sigma^2/n when nn is large.

Read the variance part carefully. The population variance σ2\sigma^2 is fixed, but dividing it by nn makes the spread of Xˉ\bar X shrink as the sample grows. Averaging cancels out much of the noise in individual observations, so a sample mean far from μ\mu becomes progressively rarer.

  • Shape: Xˉ\bar X is approximately normal for large nn, whatever the population's shape.
  • Centre: the mean of the distribution of Xˉ\bar X equals μ\mu, the population mean.
  • Spread: the variance of Xˉ\bar X equals σ2/n\sigma^2/n, so its standard deviation is σ/n\sigma/\sqrt{n}.

How large is 'large'?

The usual rule: when n≥30n \ge 30, assume the sample mean is approximately normally distributed.

That is a guideline, not a law. If the population is very non-normal, for example strongly skewed or with fat tails, a sample well above 30 may be needed before the normal distribution describes the sample mean well.

Two conditions must hold for the theorem itself: the samples are random, and the population variance is finite. The population's mean and variance need not be known; they only need to exist.

Why it matters, and what it does not say

We rarely know the shape of a population of returns, and it is often not normal. The CLT says we do not need to know it: for a large sample, the sample mean is approximately normal anyway. That lets us make precise probability statements about the population mean, construct confidence intervals (the confidence-interval lesson of this module) and test hypotheses (the hypothesis-testing module).

The CLT says nothing about individual observations. A skewed population stays skewed; only the distribution of the average of a large sample becomes approximately normal.

It also does not imply that diversifying across many investments drives portfolio risk to zero. Security returns are not independent, and portfolio risk depends on how returns move together. The CLT describes the sample mean of random draws, so it is the wrong tool for that claim.

Common misstatements
ClaimVerdict
The population must be normal for Xˉ\bar X to be normal.False: any distribution with finite variance works when n is large.
Xˉ\bar X is approximately normal for any sample size.False: only when n is large.
The mean of the sampling distribution of Xˉ\bar X is μ\mu.True.
The variance of Xˉ\bar X is σ2\sigma^2.False: it is σ2/n\sigma^2/n.
Individual returns become normal in large samples.False: only the sample mean does.

Formulas

Mean of the sample mean
E(Xˉ)=μE(\bar X) = \mu

The sampling distribution of the sample mean is centred on the population mean.

Variance of the sample mean
σXˉ2=σ2n\sigma^2_{\bar X} = \dfrac{\sigma^2}{n}

σ2\sigma^2 = population variance; n = sample size. Its square root, σ/n\sigma/\sqrt{n}, is the standard error (next lesson).

Worked examples

Example 1 Describing a sampling distribution

Daily returns on an emerging-market index are positively skewed, with μ\mu = 0.04% and σ\sigma = 1.2%. You take random samples of 144 days. Describe the sampling distribution of the sample mean.

Example 2 Spot the errors

A colleague writes: 'Because of the CLT, the mean of 12 monthly returns drawn at random from a skewed distribution is normally distributed, with variance equal to the population variance.' What is wrong?

Example 3 Can we rely on the CLT? (exam style)

For which of these can an analyst treat the sample mean as approximately normal? (1) 40 annual returns of a moderately skewed equity index; (2) 15 monthly returns of a hedge fund with extreme tail events; (3) 500 monthly returns of a strongly skewed strategy.

On the exam

Mostly conceptual: which statements about the CLT are true, what the mean and variance of Xˉ\bar X are, and the n≥30n \ge 30 rule. A short calculation of the variance or standard deviation of the sample mean is also common.

  • The population need not be normal; it must have a finite variance.
  • Variance of Xˉ\bar X is σ2/n\sigma^2/n; its standard deviation is σ/n\sigma/\sqrt{n}. Don't divide the standard deviation by n or the variance by n\sqrt{n}.
  • n≥30n \ge 30 is a guideline; very non-normal populations need more.
  • The CLT is about the sample mean, not about individual returns or portfolio diversification.

Check yourself

  1. Q1A population has a variance of 400. For random samples of 25, the variance of the sample mean is:

  2. Q2Statement 1: the means of large random samples are approximately normally distributed. Statement 2: this requires a normally distributed population. Which is correct?

  3. Q3According to the central limit theorem, the mean of the sampling distribution of the sample mean is:

  4. Q4The central limit theorem least likely requires:

  5. Q5As a rule of thumb, a sample is large enough for the sample mean to be treated as approximately normal when n is at least:

  6. Q6Annual returns across a large universe of funds have a standard deviation of 15%. For random samples of 100 funds, the standard deviation of the sample mean is closest to:

0/6Check yourself

Answer the 6 questions: +10 XP for each one you get right first time.

Liked this lesson? Get the rest free for 7 days

Create a free account to open the other 7 lessons in this module, with videos, flashcards that come back before you forget them, the question bank and full mocks. No card needed.