Back to Lesson

Teacher Guide: Linear Regression

Learn how to find the line of best fit for data and use it to make predictions.

Present LessonShare to ClassroomView Student Page

Use this lesson with your class

Free, no student accounts needed.

Share with students

Students open the lesson and practise with instant feedback.

Printable worksheet

All practice problems on paper, with a separate answer key.

Worksheet Answer key

Class quiz

10 questions on Regression. Students join with a name, you see everyone's score.

For Teachers

Learning Objectives
  • Understand the concept of linear regression and line of best fit
  • Calculate slope and y-intercept using the least squares method
  • Interpret the meaning of slope and y-intercept in context
  • Use the regression equation to make predictions
  • Recognize limitations of linear regression including extrapolation risks
Prerequisites
  • • Understanding of scatter plots and correlation
  • • Knowledge of linear equations in slope-intercept form
  • • Basic understanding of mean and summation notation
  • • Familiarity with coordinate graphing
Discussion Starters
  • 1. Why do you think the method is called 'least squares'? What are we making 'least'?
  • 2. Can you think of a real situation where two variables are related but one doesn't cause the other?
  • 3. When would it be dangerous to extrapolate a regression line far beyond your data?
  • 4. How would you decide if linear regression is a good fit for your data?
Common Misconceptions

The regression line must pass through at least two data points

Remediation: Show examples where the line doesn't pass through any points. Emphasize that the line minimizes total error, not individual distances.

A strong correlation means we can predict perfectly

Remediation: Even with strong correlation, there's always some error. Discuss residuals and why perfect prediction is rarely possible.

The y-intercept always has a meaningful interpretation

Remediation: Discuss cases where x=0 is meaningless or outside the data range. For example, predicting height at age 0 or weight at height 0.

Differentiation Ideas

For Struggling Students:

  • • Start with simple data sets (3-4 points) with nice numbers
  • • Provide graphing technology to calculate regression automatically
  • • Focus on interpretation before calculation
  • • Use visual representations to show what 'best fit' means

For On-Level Students:

  • • Calculate regression by hand for small data sets
  • • Make predictions and compare to actual values
  • • Analyze residuals to evaluate fit quality
  • • Apply regression to real-world scenarios

For Advanced Students:

  • • Explore the derivation of least squares formulas
  • • Calculate and interpret coefficient of determination (r2r^2)
  • • Compare regression lines from different data sets
  • • Investigate when residual plots indicate a poor linear fit
Standards Alignment
  • HSS.ID.B.6 (CCSS.MATH.CONTENT.HSS.ID.B.6)

    Represent data on two quantitative variables on a scatter plot, and describe how the variables are related

  • HSS.ID.B.6.C (CCSS.MATH.CONTENT.HSS.ID.B.6.C)

    Fit a linear function for a scatter plot that suggests a linear association

  • HSS.ID.C.7 (CCSS.MATH.CONTENT.HSS.ID.C.7)

    Interpret the slope and the intercept of a linear model in the context of the data

Lesson Resources
  • visualInteractive Regression Tool

    Students plot points and see the best fit line calculated in real time

  • activityData Collection Project

    Collect real data (height vs. arm span, study time vs. grades) and find regression lines

  • worksheetRegression Calculation Practice

    Practice calculating slope, intercept, and making predictions

Lesson Content

Everything students see: definition, examples, common mistakes, applications. Tap to open.

Definition

Linear regression is a statistical method for finding the straight line that best fits a set of data points. This line, called the line of best fit or regression line, keeps the vertical distances between the data points and the line as small as possible overall.
The equation of the regression line is:
y=mx+by = mx + b
Where:
  • mm is the slope (how much yy changes for each unit increase in xx)
  • bb is the y-intercept (the value of yy when x=0x = 0)
The least squares method finds the line that minimizes the sum of squared distances (residuals) from each point to the line:
Sum of Squared Residuals=∑(yi−y^i)2\text{Sum of Squared Residuals} = \sum(y_i - \hat{y}_i)^2

Worked Examples

A coffee shop tracks daily temperature (°C) and iced coffee sales:
TemperatureSales
1520
2035
2545
3060
3570
 Find the equation of the regression line.
1

Calculate the means

xˉ=15+20+25+30+355=25\bar{x} = \frac{15+20+25+30+35}{5} = 25 yˉ=20+35+45+60+705=46\bar{y} = \frac{20+35+45+60+70}{5} = 46 → xˉ=25\bar{x} = 25, yˉ=46\bar{y} = 46
2

Calculate slope using the formula

m=∑(xi−xˉ)(yi−yˉ)∑(xi−xˉ)2m = \frac{\sum(x_i - \bar{x})(y_i - \bar{y})}{\sum(x_i - \bar{x})^2} Numerator: (−10)(−26)+(−5)(−11)+(0)(−1)+(5)(14)+(10)(24)=260+55+0+70+240=625(-10)(-26) + (-5)(-11) + (0)(-1) + (5)(14) + (10)(24) = 260 + 55 + 0 + 70 + 240 = 625 Denominator: 100+25+0+25+100=250100 + 25 + 0 + 25 + 100 = 250 → m=625250=2.5m = \frac{625}{250} = 2.5
3

Calculate y-intercept

b=yˉ−mxˉ=46−2.5(25)=46−62.5=−16.5b = \bar{y} - m\bar{x} = 46 - 2.5(25) = 46 - 62.5 = -16.5 → b=−16.5b = -16.5
4

Write the regression equation

y=2.5x−16.5y = 2.5x - 16.5 → Regression line: y=2.5x−16.5y = 2.5x - 16.5

Common Mistakes

Assuming the regression line passes through all data points

Why it's wrong: The line of best fit minimizes total error but rarely passes through every point. Points above and below the line are normal.

Correct: Understand that the regression line represents the overall trend, not individual data points.

Using the regression equation for extrapolation far beyond the data range

Why it's wrong: The relationship may not hold outside the range of observed data. Predicting far beyond your data can give unrealistic results.

Correct: Be cautious when predicting for x-values far outside your data range. Note when you're extrapolating.

Confusing correlation with causation

Why it's wrong: A strong linear relationship doesn't mean one variable causes changes in the other. There may be other factors involved.

Correct: Use regression to describe relationships and make predictions, but be careful about claiming causation.

Forgetting to check if a linear model is appropriate

Why it's wrong: Not all data follows a linear pattern. Using linear regression on non-linear data gives misleading results.

Correct: Always plot your data first. If the scatter plot shows a curve, linear regression may not be the best choice.

Why It Matters

Linear regression is one of the most important tools in data analysis:
  • Business: Predict sales based on advertising spending or price changes
  • Science: Model relationships between variables in experiments
  • Medicine: Predict patient outcomes based on treatment data
  • Economics: Forecast economic indicators based on historical trends
  • Sports: Analyze player performance and predict future statistics
Understanding regression helps you make data-driven predictions and identify trends that would be impossible to see by just looking at raw numbers.

Real World Applications

Predicting Housing Prices

Real estate analysts use linear regression to estimate home prices based on features like floor area, number of bedrooms, or distance from city center.

Example:

If y=2000x+30000y = 2000x + 30000 where xx is the floor area in square meters and yy is the price in dollars, a 100 m² apartment would cost about 2000(100) + 30000 = 230000 dollars.

1Try It Yourself

A real estate model shows: Price = 2500x + 20000 (where x = square meters).

What price would you predict for a 120 m² apartment?

Step 1: Write the mathematical expression

Substitute into the equation:

Fuel Consumption Analysis

Automotive engineers use regression to understand how car weight affects fuel consumption.

Example:

If fuel consumption (L/100km) = 0.004 × weight (kg) + 2, a 1500 kg car would use 0.004(1500) + 2 = 8 L/100km.

2Try It Yourself

A car manufacturer's data shows: Fuel = 0.005w + 1.5 (where w = weight in kg).

Predict fuel consumption for a 1200 kg vehicle.

Step 1: Write the mathematical expression

Calculate:

Business Sales Forecasting

Companies use regression to predict future sales based on advertising spending, helping them allocate marketing budgets effectively.

Example:

If monthly sales = 3 × ad spending + 10000, spending 5000 dollars on ads predicts sales of 3(5000) + 10000 = 25000 dollars.

3Try It Yourself

A company's model: Sales = 4 × AdBudget + 8000.

If they spend 3000 dollars on advertising, what sales can they expect?

Step 1: Write the mathematical expression

Calculate predicted sales:

Key Takeaways

  • 1Linear regression finds the line that best fits a set of data points
  • 2The regression line equation is y=mx+by = mx + b where mm is slope and bb is y-intercept
  • 3Slope tells you how much yy changes for each unit increase in xx
  • 4The y-intercept is the predicted value of yy when x=0x = 0
  • 5Use regression to make predictions, but be cautious about extrapolating far beyond your data

Frequently Asked Questions

What if my data doesn't look linear?

If your scatter plot shows a curve rather than a straight line, linear regression may not be appropriate. Consider polynomial regression or other non-linear models instead.

Can regression prove that one thing causes another?

No. Regression shows relationships (correlations) but cannot prove causation. Two variables might be related because of a third factor, not because one causes the other.

What is a residual?

A residual is the difference between an actual data point and the predicted value from the regression line: residual = yactual−ypredictedy_{\text{actual}} - y_{\text{predicted}}. Positive residuals mean the point is above the line; negative means below.

Glossary

Linear regression
A statistical method for finding the straight line that best fits a set of data points
Line of best fit
The regression line that minimizes the sum of squared residuals
Slope
The rate of change; how much yy increases for each unit increase in xx
Y-intercept
The value of yy when x=0x = 0; where the line crosses the y-axis
Residual
The difference between an actual data point and its predicted value on the regression line
Least squares
The method that finds the line minimizing the sum of squared residuals
Extrapolation
Using a regression equation to predict values outside the range of the original data

Formula Card

Regression Line

y=mx+by = mx + b

The equation of the line of best fit where m is slope and b is y-intercept

Slope Formula

m=∑(xi−xˉ)(yi−yˉ)∑(xi−xˉ)2m = \frac{\sum(x_i - \bar{x})(y_i - \bar{y})}{\sum(x_i - \bar{x})^2}

Calculate the slope from data points using means and deviations

Y-Intercept

b=yˉ−mxˉb = \bar{y} - m\bar{x}

Calculate the y-intercept using the slope and the means of x and y

Residual

ei=yi−y^ie_i = y_i - \hat{y}_i

The difference between actual and predicted values for each point

More in This Topic

Introduction to Regression

Advanced25 min

Scatter Plots

Intermediate25 min

Line of Best Fit

Intermediate25 min

Making Predictions from Data

Intermediate25 min