9.1 Least squares, calculator work, correlation coefficients

Siyavula textbooks: grade 12 Page 1 / 2

The method of least squares

We now come to a more accurate method of finding the line of best-fit. The method is very simple. Suppose we guess a line of best-fit. Then at at every data point, we find the distance between the data point and the line. If the line fitted the data perfectly, this distance should be zero for all the data points. The worse the fit, the larger the differences. We then square each of these distances, and add them all together.

The best-fit line is then the line that minimises the sum of the squared distances.

Suppose we have a data set of $n$ points ${(x_{1}; y_{1}), (x_{2}; y_{2}), ..., (x_{n}, y_{n})}$ . We also have a line $f (x) = m x + c$ that we are trying to fit to the data. The distance between the first data point and the line, for example, is

distance = y_{1} - f (x) = y_{1} - (m x + c)

We now square each of these distances and add them together. Lets call this sum $S (m, c)$ . Then we have that

\begin{matrix} S (m, c) & = & {(y_{1} - f (x_{1}))}^{2} + {(y_{2} - f (x_{2}))}^{2} + ... + {(y_{n} - f (x_{n}))}^{2} \\ = & \sum_{i = 1}^{n} {(y_{i} - f (x_{i}))}^{2} \end{matrix}

Thus our problem is to find the value of $m$ and $c$ such that $S (m, c)$ is minimised. Let us call these minimising values $m_{0}$ and $c_{0}$ . Then the line of best-fit is $f (x) = m_{0} x + c_{0}$ . We can find $m_{0}$ and $c_{0}$ using calculus, but it is tricky, and we will just give you the result, which is that

\begin{matrix} m_{0} & = & \frac{n \sum_{i = 1}^{n} x_{i} y_{i} - \sum_{i = 1}^{n} x_{i} \sum_{i = 1}^{n} y_{i}}{n \sum_{i = 1}^{n} {(x_{i})}^{2} - {(\sum_{i = 1}^{n}, x_{i})}^{2}} \\ c_{0} & = & \frac{1}{n} \sum_{i = 1}^{n} y_{i} - \frac{m_{0}}{n} \sum_{i = 0}^{n} x_{i} = \bar{y} - m_{0} \bar{x} \end{matrix}

Khan academy video on regression - 1

In the table below, we have the records of the maintenance costs in Rands, compared with the age of the appliance in months. We have data for 5 appliances.

appliance	1	2	3	4	5
age ( $x$ )	5	10	15	20	30
cost ( $y$ )	90	140	250	300	380

Find the line of best fit using the method of least squares.

Draw up a table of

x

y

x y

and

x^{2}

values

appliance	$x$	$y$	$x y$	$x^{2}$
1	5	90	450	25
2	10	140	1400	100
3	15	250	3750	225
4	20	300	6000	400
5	30	380	11400	900
Total	80	1160	23000	1650

Work out $m_{0}$ and $c_{0}$ and write the equation
$\begin{matrix} m_{0} & = & \frac{n \sum x y - \sum x \sum y}{n \sum x^{2} - {(\sum x)}^{2}} = \frac{5 \times 23000 - 80 \times 1160}{5 \times 1650 - 80^{2}} = 12 \\ c_{0} & = & \bar{y} - b \bar{x} = \frac{1160}{5} - \frac{12 \times 80}{5} = 40 \\ ∴ & \underset{̲}{\hat{y} = 40 + 12 x} \end{matrix}$

Using a calculator

Find a regression equation for the following data:

Days ( $x$ )	1	2	3	4	5
Growth in m ( $y$ )	1,00	2,50	2,75	3,00	3,50

Getting your calculator ready
Using your calculator, change the mode from normal to “Stat $x y$ ”. This mode enables you to type in bivariate data.

Entering the data

Key in the data as follows:

1	$(x, y)$	1	DATA	$n$ = 1
2	$(x, y)$	2,5	DATA	$n$ = 2
3	$(x, y)$	2,75	DATA	$n$ = 3
4	$(x, y)$	3,0	DATA	$n$ = 4
5	$(x, y)$	3,5	DATA	$n$ = 5

Getting regression results from the calculator
Ask for the values of the regression coefficients $a$ and $b$ .

RCL $a$ gives $a =$ 0,9

RCL $b$ gives $b =$ 0,55

$∴ \hat{y} = 0, 9 + 0, 55 x$

Using a calculator determine the least squares line of best fit for the following data set of marks.

Learner	1	2	3	4	5
Chemistry (%)	52	55	86	71	45
Accounting (%)	48	64	95	79	50

For a Chemistry mark of 65%, what mark does the least squares line predict for Accounting?

Getting your calculator ready
Switch on the calculator. Press [MODE] and then select STAT by pressing [2]. The following screen will appear:

1 1-VAR 2 A + BX

3 $_$ + CX $^{2}$ 4 ln X

5 e $\hat{}$ X 6 A . B $\hat{}$ X

7 A . X $\hat{}$ B 8 1/X

Now press [2] for linear regression. Your screen should look something like this:

x y

1

2

3
Entering the data
Press [52] and then [=]to enter the first mark under $x$ . Then enter the other values, in the same way, for the $x$ -variable (the Chemistry marks) in the order in which they are given in the data set. Then move the cursor across and up and enter 48 under $y$ opposite 52 in the $x$ -column. Continue to enter the other $y$ -values (the Accounting marks) in order so that they pair off correctly with the corresponding $x$ -values.

x y

1 52

2 55

3

Then press [AC]. The screen clears but the data remains stored.

1: Type 2: Data

3: Edit 4: Sum

5: Var 6: MinMax

7: Reg

Now press [SHIFT][1]to get the stats computations screen shown below. Choose Regression by pressing [7].

1: A 2: B

3: r 4: $\hat{x}$

5: $\hat{y}$
Getting regression results from the calculator
1. a) Press [1] and [=]to get the value of the $y$ -intercept, $a = - 5, 065 . . = - 5, 07$ (to 2 d.p.) Finally, to get the slope, use the following key sequence: [SHIFT][1][7][2][=]. The calculator gives $b = 1, 169 . . = 1, 17$ (to 2 d.p.) The equation of the line of regression is thus: $\hat{y} = - 5, 07 + 1, 17 x$
2. b) Press [AC][65][SHIFT][1][7][5][=] This gives a (predicted) Accounting mark of $\hat{} = 70, 94 = 71$ %

<< Chapter < Page Page > Chapter >>

Read also:

Get Jobilize Job Search Mobile App in your pocket Now!

100% Free Mobile Applications
Receive real-time job alerts and never miss the right job again

Source: OpenStax, Siyavula textbooks: grade 12 maths. OpenStax CNX. Aug 03, 2011 Download for free at http://cnx.org/content/col11242/1.2

Google Play and the Google Play logo are trademarks of Google Inc.

Notification Switch

Would you like to follow the 'Siyavula textbooks: grade 12 maths' conversation and receive update notifications?

Ask

	Computer System Engineering By Robert Morris Start Exam
	Are you part of the R5 Family? By Anonymous User Start Quiz
	Society and Culture By Mahee Boo Start Flashcards
	22 Muscle and Pancreas Bio Path quiz By Brooke Delaney Start Exam
	15 Sociology 15 Religion MCQ By OpenStax Start Quiz
	1 Neuroscience Exam 2004 1 By David Corey Start Exam
	13 Biology 13 Modern Understandings of Inheritance By OpenStax Start Quiz
	9 Physiotherapy Modalities By Rhodes Start Exam
	5 Sociology 05 Socialization MCQ By OpenStax Start Quiz
	Vocabulary Week 1-3 By Rachel Woolard Start Quiz

1	1-VAR	2	A + BX
3	$_$ + CX $^{2}$	4	ln X
5	e $\hat{}$ X	6	A . B $\hat{}$ X
7	A . X $\hat{}$ B	8	1/X

RCL	$a$	gives	$a =$ 0,9
RCL	$b$	gives	$b =$ 0,55

1:	Type	2:	Data
3:	Edit	4:	Sum
5:	Var	6:	MinMax
7:	Reg

1:	A	2:	B
3:	r	4:	$\hat{x}$
5:	$\hat{y}$