Sampling Distributions
Learn how sample means and sample proportions vary from sample to sample, what the standard error is, and why the central limit theorem makes them approximately normal.
Definition
Sampling distribution of the sample mean
- Center: (sample means are centered on the population mean)
- Spread: , called the standard error
- Shape (central limit theorem): if the population is normal, is normal for any . If not, is still approximately normal when is large, usually .
Sampling distribution of the sample proportion
- Center:
- Spread:
- Shape: approximately normal when and
Try it now
Worked Examples
Find the number that describes the whole population
Find the number that comes from the sample
Think about a second sample
Answer: cm is the parameter, cm is a statistic. The statistic changes from sample to sample, which is exactly what a sampling distribution describes.
Common Mistakes
Using instead of in a question about a sample mean
Why it's wrong: is the spread of single values. Sample means vary much less, so using makes unusual averages look far too likely.
Correct: For always divide by the standard error: . For one value use .
Dividing by instead of
Why it's wrong: With and , dividing by gives instead of the correct standard error , so every z-score comes out 6 times too large.
Correct: Take the square root of first: .
Thinking the central limit theorem makes the population or the data normal
Why it's wrong: A large sample from a skewed population is still skewed: its histogram looks like the population. Only the distribution of the sample MEANS becomes normal.
Correct: The central limit theorem is about the sampling distribution of , not about individual values.
Using the normal model for without checking and
Why it's wrong: With and we get : most samples have 0, 1, 2 or 3 successes, and the distribution of is strongly skewed.
Correct: Check both conditions first. If one fails, take a bigger sample or use the binomial distribution.
Interactive Visual
Central limit theorem: sample means from a skewed population
- Population mean
- μ = 2.6
- Mean of the sample means
- ?
- SD of the sample means
- ?
- Standard error
- σ/√n = 2.285/√1 ≈ 2.285
Try n = 1 first, then a bigger n: the sample means pile up closer to μ, their SD shrinks like σ/√n, and the shape turns normal even when the population is not.
Average of n die rolls (μ = 3.5, σ ≈ 1.71)
- Population mean
- μ = 3.5
- Mean of the sample means
- ?
- SD of the sample means
- ?
- Standard error
- σ/√n = 1.708/√2 ≈ 1.208
Try n = 1 first, then a bigger n: the sample means pile up closer to μ, their SD shrinks like σ/√n, and the shape turns normal even when the population is not.
Poll: sample proportion when p = 0.4
- Population proportion
- p = 0.4
- Mean of the sample proportions
- ?
- SD of the sample proportions
- ?
- Standard error
- √(p(1 − p)/n) = √(0.4 · 0.6/100) ≈ 0.049
Try a small n, then a bigger one: the sample proportions pile up closer to p, their SD shrinks like √(p(1 − p)/n), and the shape turns normal.
P(x̄ < 47) when μ = 50, σ = 12, n = 36 (standard error 2)
μ = 50 h, σ = 2 h · Drag a handle or type x or z.
z = (x − μ)/σ = (47 − 50)/2 = -1.5
P(X ≤ 47) = P(Z ≤ -1.5) ≈ 0.0668 = 6.68%
About 6.68% of all values fall in the shaded region.
Interactive Sandbox
Expression Calculator
Try these:
History
No calculations yet
Practice Problems
18 problemsWhy It Matters
- Polls: a poll of 1000 voters estimates the share of all voters. The standard error tells you how far the poll is likely to be from the truth.
- Quality control: a factory checks the mean weight of a sample of packets instead of weighing every packet.
- Medicine: a clinical trial measures the mean effect on a few hundred patients and draws conclusions about everyone.
- Science: averaging repeated measurements reduces random error.
Real World Applications
Election Polls
Polling companies ask about 1000 people and report a margin of error. That margin comes straight from the standard error of $\hat{p}$.
Example:
If the true support is , a poll of 1000 people has standard error , so about 95% of such polls land within roughly 3 percentage points of the truth.
A smaller poll asks randomly chosen voters. The true support for a candidate is .
What is the standard error of the sample proportion ?
Step 1: Write the mathematical expression
Compute :
Quality Control in a Coffee Shop
Machines that fill cups are checked by averaging small samples. An average that is too far from the target, measured in standard errors, sets off an alarm.
Example:
A machine fills cups with mL and mL. An inspector measures 16 cups, so the standard error is mL.
The 16 cups have a mean of mL. The machine is set to mL with mL.
What is the z-score of this sample mean?
Step 1: Write the mathematical expression
Compute :
Planning a Medical Study
Before a study starts, researchers choose the sample size so that the standard error is small enough. Because of the square root, halving the error needs four times as many patients.
Example:
Blood pressure has mmHg. With 25 patients the standard error is mmHg; with 100 patients it is mmHg.
Researchers want the standard error of the mean blood pressure to be 2 mmHg. The population standard deviation is mmHg.
How many patients do they need?
Step 1: Write the mathematical expression
From we get :
Key Takeaways
- 1A parameter (, , ) describes the population and is fixed; a statistic (, ) comes from a sample and varies from sample to sample
- 2The sampling distribution of has mean and standard error
- 3Central limit theorem: for (about) the sample mean is approximately normal whatever the population shape; if the population is normal, for any
- 4For a probability about a sample mean use and the z-table
- 5The sample proportion has mean and standard error ; it is approximately normal when and
- 6Bigger samples give more precise estimates: four times the sample size halves the standard error
Frequently Asked Questions
Glossary
- Parameter
- A number that describes a whole population, such as , or ; usually unknown
- Statistic
- A number computed from a sample, such as or ; it changes from sample to sample
- Sampling distribution
- The distribution of a statistic over all possible random samples of the same size
- Standard error
- The standard deviation of a sampling distribution, for example for the sample mean
- Central limit theorem
- For large the sampling distribution of the sample mean is approximately normal, whatever the shape of the population
- Sample proportion
- The share of successes in a sample,
Formula Card
Mean of the sample mean
Sample means are centered on the population mean
Standard error of the mean
Spread of the sample means; shrinks as $n$ grows
z-score of a sample mean
Use with the z-table when $n \geq 30$ or the population is normal
Standard error of a proportion
Normal model if $np \geq 10$ and $n(1-p) \geq 10$