Aimathic
Login | English | Deutsch

Free math worksheets

Build your own math worksheets from 28,000 problems for grades 3 to 12, from fractions to calculus. Every problem includes step-by-step solutions.

Least-squares regression

Click problems to add them to your worksheet.

53948612
A least-squares regression of boxes packed on number of volunteers reports \(r^2 = 0.64\). Interpret \(r^2\) in context and state the percentage of variation not explained by the linear relationship.

Hints

- Interpret \(r^2\) using variation in the response variable, boxes packed. - Convert the decimal \(0.64\) to a percentage. - Subtract the explained percentage from \(100\%\) to find the unexplained portion.

Solution

1. Convert \(r^2 = 0.64\) to \(64\%\). 2. About \(64\%\) of the observed variation in boxes packed is explained by the least-squares linear relationship with number of volunteers. 3. The unexplained percentage is \(100\% - 64\% = 36\%\).

Answer

About \(64\%\) of the observed variation in boxes packed is explained by its linear relationship with number of volunteers; about \(36\%\) is not explained by that linear relationship.
53949512
Two lines fitted to fabric weight and drape score have the same sum of absolute residuals. Line A has a sum of squared residuals of \(28\), and Line B has a sum of squared residuals of \(19\). Which line is preferred by the least-squares criterion?

Hints

- Identify which residual measure the least-squares method minimizes. - The equal sums of absolute residuals do not decide the least-squares comparison. - Compare \(19\) and \(28\).

Solution

1. The least-squares criterion selects the line with the smaller sum of squared residuals. 2. Since \(19 < 28\), Line B is preferred.

Answer

Line B, because its sum of squared residuals is smaller.
53948112
Use technology to find the least-squares regression line for ramp height \(x\), in centimeters, and toy-car speed \(y\), in centimeters per second. Also report \(r^2\). Round all reported values to three decimal places. <table> <thead><tr><th>Ramp height in centimeters</th><th>Toy-car speed in centimeters per second</th></tr></thead> <tbody> <tr><td>1</td><td>5.9</td></tr> <tr><td>2</td><td>6.4</td></tr> <tr><td>3</td><td>8.7</td></tr> <tr><td>4</td><td>10.8</td></tr> <tr><td>5</td><td>11.0</td></tr> <tr><td>6</td><td>13.1</td></tr> </tbody> </table>

Hints

- Enter ramp heights and speeds in corresponding technology lists. - Use linear regression output for both the intercept and slope rather than estimating from two points. - Square the reported correlation only if the technology does not display \(r^2\) directly.

Solution

1. Enter the paired ramp-height and speed data and run linear regression. 2. The unrounded slope is \(1.482857\ldots\), and the unrounded intercept is \(4.126667\ldots\). 3. The least-squares regression line is \(\hat y \approx 4.127 + 1.483x\). 4. The coefficient of determination is \(r^2 = 0.964213\ldots \approx 0.964\).

Answer

\(\hat y \approx 4.127 + 1.483x\), with \(r^2 \approx 0.964\).
53948212
A least-squares regression line for crowd size \(x\) and wait time \(y\) has slope \(b = 1.40\). The sample means are \(\bar x = 8.0\) and \(\bar y = 22.0\). Find the intercept without refitting the data.

Hints

- Use the fact that the least-squares line contains the point of sample means. - Substitute \(\bar x\), \(\bar y\), and the given slope into \(\bar y = a + b\bar x\). - Isolate \(a\) and check that the line predicts \(22.0\) when \(x = 8.0\).

Solution

1. A least-squares regression line passes through \((\bar x, \bar y) = (8.0, 22.0)\). 2. Use \(\bar y = a + b\bar x\): \(22.0 = a + 1.40(8.0)\). 3. Solve: \(a = 22.0 - 11.20 = 10.80\).

Answer

The intercept is \(a = 10.80\).
53948312
A least-squares regression line for water temperature \(x\) and dissolving time \(y\) has slope \(b = -1.90\). The sample means are \(\bar x = 11.0\) and \(\bar y = 27.0\). Find the intercept without refitting the data.

Hints

- Start with the point \((\bar x, \bar y)\) on the fitted line. - Keep the negative sign on the slope when substituting. - Rearranging a subtraction term requires adding \(1.90(11.0)\) to both sides.

Solution

1. A least-squares regression line passes through \((\bar x, \bar y) = (11.0, 27.0)\). 2. Use \(\bar y = a + b\bar x\): \(27.0 = a - 1.90(11.0)\). 3. Solve: \(a = 27.0 + 20.90 = 47.90\).

Answer

The intercept is \(a = 47.90\).
53948812
A least-squares regression line relating average speed \(x\), in miles per hour, and travel time \(y\), in minutes, is \(\hat y = 49.848 - 1.632x\). If \(\bar x = 14.0\), find \(\bar y\).

Hints

- Use the defining point \((\bar x, \bar y)\) on the least-squares line. - Substitute the mean x-value directly into the fitted equation. - The arithmetic is exact with the given coefficients, so use \(=\), not \(\approx\).

Solution

1. A least-squares regression line passes through \((\bar x, \bar y)\). 2. Substitute \(\bar x = 14.0\): \(\bar y = 49.848 - 1.632(14.0)\). 3. \(\bar y = 49.848 - 22.848 = 27.000\).

Answer

\(\bar y = 27.000\) minutes.
53949212
A least-squares regression of light intensity on distance from a lamp has \(r^2 = 0.79\). Both variables are converted to different units using positive linear conversions. Explain what happens to \(r^2\).

Hints

- Think about whether changing units changes the relative positions of the observations. - Positive shifts and rescalings leave standardized values unchanged. - Use the relationship between \(r\) and \(r^2\).

Solution

1. A positive linear conversion shifts and/or rescales a variable without changing its standardized values. 2. Therefore, the correlation \(r\) is unchanged. 3. Because \(r^2\) is the square of the correlation, \(r^2\) remains \(0.79\).

Answer

\(r^2\) remains \(0.79\) because positive linear unit conversions do not change the correlation.
53949312
Two regression models are fitted to the same response data for shadow length as a function of hours after sunrise. Model A has \(r^2 = 0.72\) and a sum of squared residuals of \(18.4\). Model B has \(r^2 = 0.81\) and a sum of squared residuals of \(12.5\). Which model gives the better in-sample fit? Explain using both measures.

Hints

- Compare the two \(r^2\) values: larger indicates more explained variation. - Compare the two sums of squared residuals: smaller indicates less total squared prediction error. - These comparisons are valid because both models use the same response data.

Solution

1. For models fitted to the same response data, a larger \(r^2\) means the model explains more of the variation in the response. 2. A smaller sum of squared residuals means the observed values are closer to the fitted values overall. 3. Model B has both the larger \(r^2\), \(0.81 > 0.72\), and the smaller sum of squared residuals, \(12.5 < 18.4\). Therefore, Model B gives the better in-sample fit.

Answer

Model B gives the better in-sample fit because it has the larger \(r^2\) and the smaller sum of squared residuals.
53949412
A student says that the least-squares regression line for snow depth and travel time minimizes the sum of the residuals. Correct the statement and explain why the student’s version cannot define a unique best-fitting line.

Hints

- Recall the exact quantity minimized by the least-squares method. - Consider what happens when one residual is positive and another is negative. - Think about why squaring each residual before adding makes the criterion useful.

Solution

1. The least-squares regression line minimizes the sum of the squared residuals, not the sum of the residuals. 2. Positive and negative residuals can cancel. In fact, any fitted line that passes through \((\bar x, \bar y)\) has residuals that sum to \(0\). 3. Because many lines can have a residual sum of \(0\), that criterion does not identify a unique best-fitting line. Squaring the residuals prevents cancellation and penalizes larger errors.

Answer

The least-squares regression line minimizes the sum of squared residuals. Unsquared residuals can cancel, and many lines can have a residual sum of \(0\), so minimizing their sum does not identify a unique best-fitting line.
54795312
Software reports a least-squares regression for two quantitative variables with correlation \(r=0.84\), but the reported fitted slope is \(b=-2.10\). Without seeing the raw data, determine whether both reported values can be correct for the same simple linear regression. Explain.

Hints

- Compare the direction represented by the correlation with the direction represented by the fitted line. - Think about whether changing scale factors can reverse the sign in the relationship between these two statistics.

Solution

1. In simple linear regression, the fitted slope and the correlation coefficient must have the same sign because the two standard deviations are positive. 2. The reported correlation is positive, while the reported slope is negative. 3. Therefore, the two values cannot both come from the same least-squares regression.

Answer

No. A positive correlation requires a positive least-squares slope, so \(r=0.84\) and \(b=-2.10\) are inconsistent.
54797312
A least-squares regression has \(r^2=0.81\). A student says, “That means \(81\%\) of the observed points lie on the regression line.” Correct the student’s interpretation.

Hints

- Ask whether \(r^2\) summarizes point counts or variation. - Connect the statistic to explained and unexplained response variability. - A fitted line can explain much variation even when no point lies exactly on it.

Solution

1. The coefficient of determination does not count how many observations lie exactly on the fitted line. 2. The value \(r^2=0.81\) means that \(81\%\) of the variation in the response variable is explained by its linear relationship with the explanatory variable in this model. 3. The remaining \(19\%\) of response variation is not explained by that linear relationship.

Answer

\(r^2=0.81\) means that \(81\%\) of the variation in the response is explained by the fitted linear relationship, not that \(81\%\) of the points lie on the line.
54798412
A least-squares regression is performed after both variables are standardized to z-scores. The fitted line is \(\hat z_y=-0.65z_x\). Find the correlation \(r\) and the coefficient of determination \(r^2\).

Hints

- Think about the form of a least-squares line when both variables are measured in standard-deviation units. - Connect the standardized fitted slope to the strength and direction of the linear association. - Square the correlation only after identifying its sign.

Solution

1. For standardized variables, the least-squares regression line has intercept \(0\) and slope equal to the correlation. 2. Therefore, \(r=-0.65\). 3. The coefficient of determination is \(r^2=(-0.65)^2=0.4225\).

Answer

\(r=-0.65\) and \(r^2=0.4225\).
54800212
In a fitted regression model, one observation has residual \(2.0\). Suppose that observation moves so its residual becomes \(4.0\), while every other residual stays the same. By how much does this observation’s contribution to the sum of squared residuals increase? Explain what this illustrates about the least-squares criterion.

Hints

- Focus on how one residual enters the least-squares objective. - Compare the squared contribution before and after the change. - Think about how squaring changes the impact of a residual as its magnitude grows.

Solution

1. With residual \(2.0\), the observation contributes \((2.0)^2=4.0\) to the sum of squared residuals. 2. With residual \(4.0\), it contributes \((4.0)^2=16.0\). 3. The contribution increases by \(16.0-4.0=12.0\), even though the residual itself only doubled. 4. Squaring makes large residuals contribute disproportionately more to the least-squares criterion.

Answer

The contribution increases by \(12.0\), from \(4.0\) to \(16.0\). This illustrates that least squares penalizes larger residuals more heavily because residuals are squared.
54801112
A least-squares regression line with an intercept is fitted to \(10\) observations. The observed response values have a total of \(250\). Without knowing the individual fitted values, find the total of the \(10\) predicted responses \(\hat y_i\). Explain the property you use.

Hints

- Use a property of the residuals from a least-squares fit with an intercept. - Write the residual sum as the difference between two totals. - You do not need any individual prediction to determine the total.

Solution

1. For a least-squares regression line with an intercept, the residuals sum to \(0\): \(\sum(y_i-\hat y_i)=0\). 2. Therefore, \(\sum y_i=\sum\hat y_i\). 3. Since the observed responses total \(250\), the predicted responses also total \(250\).

Answer

The predicted responses total \(250\). For a least-squares line with an intercept, the residuals sum to \(0\), so the sum of the fitted responses equals the sum of the observed responses.
54807412
An ordinary least-squares regression line passes through the original sample means \((\bar x,\bar y)\). One observation is then removed and the regression is refitted. A student says, “The new least-squares line must still pass through the old point \((\bar x,\bar y)\).” Evaluate the statement.

Hints

- Identify which data set the mean-point property refers to. - Ask whether deleting an observation can change the sample means. - The regression is refitted to the remaining observations, not constrained by summaries from the old data set.

Solution

1. The mean-point property applies to the data set used for the particular least-squares fit. 2. Removing an observation can change both the sample mean of \(x\) and the sample mean of \(y\). 3. The refitted line must pass through the new means of the remaining observations, not necessarily through the old means from the full data set.

Answer

The statement is incorrect. After an observation is removed, the refitted least-squares line passes through the new sample means of the remaining data, which need not equal the original \((\bar x,\bar y)\).
54808812
A least-squares regression line is \(\hat y=5+2x\). An analyst creates a new response variable \(y^*=y+10\) for every observation while leaving \(x\) unchanged, then refits the least-squares line. Determine the new regression line. State what happens to the residuals and to the sum of squared errors.

Hints

- Consider how a vertical shift of every observed point affects the best-fitting line. - Compare an old residual with the corresponding residual after both the observation and its fitted value shift. - The sum of squared errors depends only on the residuals.

Solution

1. Adding \(10\) to every response shifts every observed point upward by \(10\) without changing the linear association with \(x\). 2. The fitted value at each \(x\) also increases by \(10\), so the new line is \(\hat y^*=15+2x\). 3. Each new residual is \(y^*-\hat y^*=(y+10)-(\hat y+10)=y-\hat y\), so every residual is unchanged. 4. Because the residuals are unchanged, the sum of squared errors is unchanged.

Answer

The new least-squares line is \(\hat y^*=15+2x\). All residuals stay the same, so the sum of squared errors also stays the same.
54809412
A data set has \(\bar x=8\), \(\bar y=25\), and least-squares slope \(b=-1.5\). A report lists the regression line as \(\hat y=40-1.5x\). Check the reported line using a property of the least-squares regression line. If it is incorrect, find the correct intercept.

Hints

- Recall the point that every least-squares line with an intercept must pass through. - Substitute the given means into the reported equation. - If the check fails, use the known slope and mean point to determine the intercept.

Solution

1. A least-squares regression line with an intercept passes through \((\bar x, \bar y)=(8, 25)\). 2. The reported line gives \(\hat y=40-1.5\cdot8=28\), not \(25\), so it cannot be the stated least-squares line. 3. The correct intercept satisfies \(25=a-1.5\cdot8\). 4. Thus \(a=25+12=37\), giving \(\hat y=37-1.5x\).

Answer

The reported line is incorrect because it does not pass through \((8, 25)\). The correct line is \(\hat y=37-1.5x\).
54810212
Two candidate lines fitted to the same three observations produce these residuals: Line A: \(-3, 0, 3\) Line B: \(-2, -1, 3\) Both lines have the same sum of absolute residuals. Which line has the smaller least-squares criterion, and why?

Hints

- Identify the quantity that least-squares regression minimizes. - Apply that criterion separately to the two residual lists. - Do not let the equal sums of absolute residuals decide the comparison.

Solution

1. For line A, the sum of squared residuals is \((-3)^2+0^2+3^2=18\). 2. For line B, the sum of squared residuals is \((-2)^2+(-1)^2+3^2=14\). 3. Least squares compares squared residuals, not absolute residuals. 4. Therefore, line B has the smaller least-squares criterion even though both absolute-residual sums equal \(6\).

Answer

Line B. Its sum of squared residuals is \(14\), compared with \(18\) for line A.
54812412
A least-squares regression line is \(\hat y=4+6x\). The analyst creates a new explanatory variable \(x^*=3x\) and refits the regression using \(x^*\). Find the new least-squares equation and state what happens to the fitted values, residuals, and SSE.

Hints

- Express the original explanatory variable in terms of the rescaled one. - Substitute that expression into the original fitted equation. - Decide whether changing only the horizontal units changes any vertical prediction errors.

Solution

1. Because \(x=\frac{x^*}{3}\), substitute into the original equation: \(\hat y=4+6\left(\frac{x^*}{3}\right)=4+2x^*\). 2. Each observation represents the same underlying explanatory value, only on a rescaled axis, so its fitted response is unchanged. 3. Since observed and fitted responses are unchanged, every residual is unchanged. 4. Therefore, the SSE is also unchanged.

Answer

The new equation is \(\hat y=4+2x^*\). The fitted values, residuals, and SSE all remain unchanged.
54815312
A simple least-squares regression predicts delivery time, in minutes, from route distance. The model is fitted to \(n=12\) observations and has \(SSE=50\). Compute the residual standard deviation \(s=\sqrt{\frac{SSE}{n-2}}\), and interpret it in context.

Hints

- Use the residual degrees of freedom for a simple linear regression. - Divide the SSE by those degrees of freedom before taking the square root. - Interpret the result as a typical vertical prediction error in the response variable's units.

Solution

1. The residual degrees of freedom are \(12-2=10\). 2. The residual mean square is \(\frac{50}{10}=5\). 3. Therefore, \(s=\sqrt{5}\approx2.236\) minutes. 4. The observed delivery times typically differ from their fitted values by about \(2.24\) minutes, as measured by the residual standard deviation.

Answer

\(s\approx2.24\,\text{minutes}\). Observed delivery times typically fall about \(2.24\) minutes from the values predicted by the fitted line.
53947912
For a sample relating practice hours \(x\) and performance score \(y\), \(\bar x = 10.0\), \(s_x = 2.5\), \(\bar y = 30.0\), \(s_y = 5.5\), and \(r = 0.82\). Find the least-squares regression line and \(r^2\). Round coefficients and \(r^2\) to three decimal places.

Hints

- Use \(b = r\frac{s_y}{s_x}\) to find the regression slope from summary statistics. - The least-squares line passes through \((\bar x, \bar y)\), which determines the intercept. - Square the correlation and round only after computing the exact decimal.

Solution

1. Compute the slope: \(b = r\frac{s_y}{s_x} = 0.82\left(\frac{5.5}{2.5}\right) = 1.804\). 2. Compute the intercept: \(a = \bar y - b\bar x = 30.0 - 1.804(10.0) = 11.960\). 3. The least-squares regression line is \(\hat y = 11.960 + 1.804x\). 4. The coefficient of determination is \(r^2 = (0.82)^2 = 0.6724 \approx 0.672\).

Answer

\(\hat y = 11.960 + 1.804x\), with \(r^2 \approx 0.672\).
53948012
For a sample relating distance from a heater \(x\) and temperature \(y\), \(\bar x = 12.0\), \(s_x = 2.9\), \(\bar y = 33.0\), \(s_y = 6.2\), and \(r = -0.71\). Find the least-squares regression line and \(r^2\). Round coefficients and \(r^2\) to three decimal places.

Hints

- Use the negative correlation in \(b = r\frac{s_y}{s_x}\), so the fitted slope must be negative. - Find the intercept by forcing the line through \((\bar x, \bar y)\). - Squaring \(r\) removes the sign; round \(r^2\) only at the end.

Solution

1. Compute the slope: \(b = r\frac{s_y}{s_x} = -0.71\left(\frac{6.2}{2.9}\right) = -1.517931\ldots \approx -1.518\). 2. Compute the intercept: \(a = \bar y - b\bar x = 33.0 - (-1.517931\ldots)(12.0) = 51.215172\ldots \approx 51.215\). 3. The least-squares regression line is \(\hat y = 51.215 - 1.518x\). 4. The coefficient of determination is \(r^2 = (-0.71)^2 = 0.5041 \approx 0.504\).

Answer

\(\hat y = 51.215 - 1.518x\), with \(r^2 \approx 0.504\).
53948412
A student claims that \(\hat y = 1.40 + 2.40x\) is the least-squares regression line. The sample means are \(\bar x = 14.0\) and \(\bar y = 32.0\). Test the claim using a defining property of a least-squares regression line.

Hints

- Recall the point that every least-squares regression line must contain. - Evaluate the proposed equation at the given mean x-value. - Compare that prediction with the given mean y-value.

Solution

1. A least-squares regression line must pass through \((\bar x, \bar y) = (14.0, 32.0)\). 2. At \(x = 14.0\), the proposed line gives \(\hat y = 1.40 + 2.40(14.0) = 35.00\). 3. Because \(35.00 \ne 32.0\), the proposed line does not pass through the sample-mean point and cannot be the least-squares line.

Answer

The claim is false. At \(x = \bar x = 14.0\), the proposed line predicts \(35.00\), but a least-squares line must predict \(\bar y = 32.0\).
53948712
For a least-squares regression line relating tea steeping time and flavor score, the slope is \(b = 1.875\), \(s_x = 2.0\), and \(s_y = 5.0\). Find the correlation \(r\).

Hints

- Rearrange the regression-slope formula to isolate \(r\). - The sign of \(r\) must match the positive slope. - Check that the result lies within the allowable interval \([-1, 1]\).

Solution

1. Start with \(b = r\frac{s_y}{s_x}\). 2. Solve for correlation: \(r = b\frac{s_x}{s_y}\). 3. Substitute: \(r = 1.875\left(\frac{2.0}{5.0}\right) = 0.750\).

Answer

\(r = 0.750\).
53948912
The least-squares regression line is \(\hat y = 20.00 + 1.50x\), with \(r^2 = 0.64\). An analyst multiplies every response value by \(10\). Give the transformed regression line and \(r^2\).

Hints

- Multiplying every response value changes both fitted-response coefficients. - Apply the factor \(10\) to the intercept and slope. - Positive rescaling does not change standardized association or \(r^2\).

Solution

1. Let the transformed response be \(y^* = 10y\), so \(\hat y^* = 10\hat y\). 2. Multiply the entire fitted equation by \(10\): \(\hat y^* = 10(20.00 + 1.50x) = 200.00 + 15.00x\). 3. Positive rescaling of the response does not change correlation, so \(r^2\) remains \(0.64\).

Answer

\(\hat y^* = 200.00 + 15.00x\), with \(r^2 = 0.64\).
53949012
The least-squares regression line is \(\hat y = 24.00 - 1.90x\), with \(r^2 = 0.69\). An analyst adds \(50\) to every response value. Give the transformed regression line and \(r^2\).

Hints

- Adding a constant to every response shifts all fitted values vertically. - A vertical shift changes the intercept but not the slope. - Correlation and \(r^2\) are unaffected by adding a constant.

Solution

1. Let the transformed response be \(y^* = y + 50\), so \(\hat y^* = \hat y + 50\). 2. Add \(50\) to the intercept: \(\hat y^* = 74.00 - 1.90x\); the slope is unchanged. 3. Shifting the response by a constant does not change correlation, so \(r^2\) remains \(0.69\).

Answer

\(\hat y^* = 74.00 - 1.90x\), with \(r^2 = 0.69\).
53949112
A least-squares regression line is \(\hat y = 28.00 + 2.30x\), with \(r^2 = 0.74\). Define a new explanatory variable \(x^* = 100x\). Write the regression line in terms of \(x^*\), and state the new slope, intercept, and \(r^2\).

Hints

- Express the old explanatory variable \(x\) in terms of the new variable \(x^*\). - Substitute that expression into the original regression equation. - A positive rescaling of \(x\) changes the slope’s units but not the fitted values or \(r^2\).

Solution

1. Since \(x^* = 100x\), write \(x = \frac{x^*}{100}\). 2. Substitute into the original line: \(\hat y = 28.00 + 2.30\left(\frac{x^*}{100}\right) = 28.00 + 0.0230x^*\). 3. Rescaling the explanatory variable by a positive constant does not change the fitted values or \(r^2\). Therefore, the new slope is \(0.0230\), the intercept is \(28.00\), and \(r^2 = 0.74\).

Answer

\(\hat y = 28.00 + 0.0230x^*\); slope \(0.0230\), intercept \(28.00\), and \(r^2 = 0.74\).
54794012
A study of wind speed and kite-line tension has summary statistics \(\bar x=16.0\), \(s_x=4.0\), \(\bar y=11.0\), \(s_y=3.2\), and \(r=0.75\). Here, \(x\) is wind speed in miles per hour and \(y\) is line tension in pounds. Three students report these possible least-squares regression lines: A. \(\hat y=1.4+0.6x\) B. \(\hat y=20.6-0.6x\) C. \(\hat y=2.0+0.6x\) Which line could be the least-squares regression line? Justify your choice using the summary statistics.

Hints

- Compare what the summary statistics imply about the direction and scale of the fitted line. - A least-squares line has a required relationship to the two sample means. - Check more than one feature of each candidate before deciding.

Solution

1. The least-squares slope is \(b=r\frac{s_y}{s_x}=0.75\cdot\frac{3.2}{4.0}=0.600\). 2. A least-squares regression line passes through \((\bar x,\bar y)=(16.0,11.0)\), so \(a=11.0-0.600\cdot16.0=1.4\). 3. Therefore, only line A has both the required slope and intercept.

Answer

Line A, \(\hat y=1.4+0.6x\).
54794812
Two linear regression models are fitted to the same response data. For both models, the total sum of squares for the response is \(320\). Model A has a sum of squared residuals of \(72\). Model B has \(r^2=0.740\). Find \(r^2\) for Model A and determine which model explains the larger proportion of the variation in the response.

Hints

- Compare explained variation with the part left in the residuals. - The two models use the same response data, so the total response variation is the same. - Convert the unexplained fraction into the explained fraction before comparing the models.

Solution

1. For Model A, the unexplained proportion is \(\frac{72}{320}=0.225\). 2. Therefore, \(r^2=1-0.225=0.775\). 3. Since \(0.775>0.740\), Model A explains the larger proportion of the response variation.

Answer

Model A has \(r^2=0.775\), so Model A explains more of the variation than Model B.
54796412
Two lines are fitted to the same bivariate data. For both lines, the residuals sum to \(0\). Line A has a sum of squared residuals of \(14.2\), while Line B has a sum of squared residuals of \(9.7\). A student says, “Both lines must be least-squares regression lines because both residual sums are zero.” Evaluate the claim and identify which line is preferred by the least-squares criterion.

Hints

- Separate a property that a fitted line may have from the criterion that defines “least squares.” - Compare the two measures of prediction error that are given. - Ask which quantity the fitting procedure actually minimizes.

Solution

1. A zero residual sum is a property of an ordinary least-squares line with an intercept, but that property alone does not identify the least-squares line. 2. The least-squares criterion selects the line with the smallest sum of squared residuals. 3. Since \(9.7<14.2\), Line B is preferred.

Answer

The student’s claim is incorrect. A residual sum of \(0\) is not enough by itself. Line B is preferred because its sum of squared residuals, \(9.7\), is smaller.
54799112
A least-squares regression line is \(\hat y=18.0+1.4x\), and the sample mean of the explanatory variable is \(\bar x=10.0\). Define centered variables \(X=x-\bar x\) and \(Y=y-\bar y\). Find \(\bar y\) and write the least-squares regression line for predicting \(Y\) from \(X\). Explain what happens to the slope.

Hints

- Use a defining location property of the least-squares regression line to recover the missing mean. - Express the original variables in terms of their centered versions. - Think about whether subtracting constants changes rates of change.

Solution

1. A least-squares regression line passes through \((\bar x, \bar y)\), so \(\bar y=18.0+1.4\cdot10.0=32.0\). 2. Since \(x=X+10.0\) and \(\hat y=\hat Y+32.0\), substitute into the fitted line to get \(\hat Y+32.0=18.0+1.4(X+10.0)\). 3. Simplifying gives \(\hat Y=1.4X\). 4. Centering subtracts constants from the variables, so it changes the intercept but not the least-squares slope.

Answer

\(\bar y=32.0\), and the centered regression line is \(\hat Y=1.4X\). The slope remains \(1.4\).
54802612
A least-squares regression line is \(\hat y=4.0+1.5x\), and its sum of squared residuals is \(20.0\). An analyst defines a new response \(y^*=-2y\) and refits the equivalent least-squares regression using the same \(x\)-values. Write the new regression line, find the new sum of squared residuals, and state what happens to \(r^2\).

Hints

- Apply the response transformation to the fitted values as well as the observations. - Track how the transformation changes each residual before squaring it. - Compare explained and total variation after the same response scaling.

Solution

1. Multiplying every response by \(-2\) multiplies every fitted response by \(-2\), so the new line is \(\hat y^*=-8.0-3.0x\). 2. Each new residual is \(-2\) times the corresponding original residual. 3. Squaring the residuals multiplies each squared residual by \(4\), so the new sum of squared residuals is \(4\cdot20.0=80.0\). 4. A nonzero linear rescaling of the response does not change the proportion of response variation explained, so \(r^2\) is unchanged.

Answer

\(\hat y^*=-8.0-3.0x\), the new sum of squared residuals is \(80.0\), and \(r^2\) is unchanged.
54804212
A data set has varying explanatory values, but every response value equals \(7\). A student says, “The horizontal line \(\hat y=7\) fits perfectly, so the correlation must be \(1\).” Evaluate the statement. Identify the least-squares line and its sum of squared residuals, and explain what happens to the correlation.

Hints

- First check whether the fitted line reproduces every response exactly. - Then recall what correlation requires about the variability of both variables. - A perfect prediction in a degenerate data set is not the same as a perfect increasing linear association.

Solution

1. The horizontal line \(\hat y=7\) predicts every observed response exactly, so every residual is \(0\). 2. Therefore, \(\hat y=7\) is the least-squares line and the sum of squared residuals is \(0\). 3. However, the response standard deviation is \(0\) because every \(y\)-value is identical. 4. Correlation is undefined when either variable has zero standard deviation, so the correlation is not \(1\).

Answer

The least-squares line is \(\hat y=7\) and its sum of squared residuals is \(0\). The correlation is undefined because the response variable has no variation.
54806112
Model A predicts a response measured in dollars and has \(SSE=420\). Model B predicts a different response measured in cents and has \(SSE=18{,}000\). A student says, “Model A fits better because \(420<18{,}000\).” Evaluate the comparison.

Hints

- Identify the units carried by a squared residual. - Ask whether the two sums of squares are measured on the same response scale. - A numerical comparison is meaningful only when the quantities being compared have a common scale and role.

Solution

1. A sum of squared residuals is measured in squared response units, so its numerical size depends on the scale of the response variable. 2. Model A and Model B use different responses and different units, so their raw \(SSE\) values are not on a common scale. 3. A smaller numerical \(SSE\) can support a better fit when models are compared on the same observations and response scale, but it cannot be used directly to rank unrelated fits with different response scales.

Answer

The comparison is not valid. Raw \(SSE\) values depend on the response scale and have squared response units, so \(420\) dollars squared and \(18{,}000\) cents squared are not directly comparable measures of fit across different responses.
54806812
A software report rounds a least-squares regression line to \(\hat y=1.23+0.46x\). The sample means are \(\bar x=10.4\) and \(\bar y=6.01\). Substituting \(\bar x\) into the rounded line gives \(\hat y=6.014\), not exactly \(6.01\). A student says, “Then this cannot be the least-squares regression line.” Evaluate the claim.

Hints

- Distinguish the exact fitted coefficients from their rounded display values. - Compare the size of the discrepancy with the precision of the reported coefficients. - A defining property applies to the exact fitted line, not necessarily to every rounded representation of it.

Solution

1. An exact least-squares regression line with an intercept passes through \((\bar x,\bar y)\). 2. The displayed coefficients have been rounded, so the displayed line need not reproduce \(\bar y\) exactly when evaluated at \(\bar x\). 3. Here, the discrepancy is only \(6.014-6.01=0.004\), which is consistent with coefficient rounding. 4. The rounded display therefore does not show that the underlying fitted line violates the mean-point property.

Answer

The claim is not justified. The exact least-squares line passes through \((\bar x,\bar y)\), but rounded coefficients can produce a small discrepancy. A difference of \(0.004\) is consistent with rounding.
54808212
A data set has explanatory-variable standard deviation \(s_x=3.0\) and response standard deviation \(s_y=12.0\). What is the largest possible magnitude of the least-squares regression slope? What would it imply about the correlation if the slope magnitude reached that maximum?

Hints

- Use the relationship among least-squares slope, correlation, and the two standard deviations. - Apply the allowable range of the correlation coefficient. - Consider what equality in that bound would require.

Solution

1. The least-squares slope is \(b=r\frac{s_y}{s_x}\). 2. Because \(|r|\le1\), \(|b|\le\frac{12.0}{3.0}=4.0\). 3. If \(|b|=4.0\), then \(|r|=1\), so the observations have a perfect linear association. 4. The sign of the slope would determine whether the perfect association is increasing or decreasing.

Answer

The largest possible slope magnitude is \(4.0\). Reaching that magnitude would require \(|r|=1\), a perfect linear association.
54811312
For a data set, \(\sum (x_i-\bar x)(y_i-\bar y)=60\) and \(\sum (x_i-\bar x)^2=24\). The sample means are \(\bar x=4\) and \(\bar y=13\). Find the least-squares regression line.

Hints

- Use the centered cross-product information to determine the slope. - Then use the fact that the least-squares line passes through the point of sample means. - Check the final equation by substituting \(x=\bar x\).

Solution

1. The least-squares slope is \(b=\frac{\sum (x_i-\bar x)(y_i-\bar y)}{\sum (x_i-\bar x)^2}=\frac{60}{24}=2.5\). 2. The intercept satisfies \(a=\bar y-b\bar x\). 3. Thus \(a=13-2.5\cdot4=3\).

Answer

The least-squares regression line is \(\hat y=3+2.5x\).
54813112
An analyst duplicates every observation in a data set exactly once, creating a new data set in which each original ordered pair appears twice. What happens to the least-squares regression coefficients and to the sum of squared errors compared with the original fit?

Hints

- Think about how duplicating every point affects the objective value for any one candidate line. - Ask whether multiplying every candidate objective by the same factor changes the minimizer. - Then count how many times each original squared residual appears in the duplicated data set.

Solution

1. For any candidate line, duplicating every observation duplicates every residual and therefore doubles that line's SSE. 2. Multiplying every candidate SSE by the same positive factor does not change which line minimizes SSE. 3. Therefore, the least-squares slope and intercept are unchanged. 4. At the unchanged fitted line, each original squared residual appears twice, so the fitted SSE doubles.

Answer

The least-squares slope and intercept stay the same, while the SSE doubles.
54813712
A least-squares model is deliberately constrained to pass through the origin, so it has the form \(\hat y=bx\) with no intercept. Must the residuals from this fit sum to zero? Explain.

Hints

- Identify which fitted coefficient allows a line to shift vertically. - The usual residual properties depend on which parameters are free in the optimization. - Compare estimating an intercept with fixing it in advance.

Solution

1. The zero-sum residual property comes from estimating a free intercept in ordinary least-squares regression. 2. When the intercept is fixed at \(0\), the optimization chooses only the slope and does not impose the same condition on the residual sum. 3. Therefore, a through-origin least-squares fit can have \(\sum e_i\ne0\).

Answer

No. Residuals are guaranteed to sum to zero for an ordinary least-squares fit with a fitted intercept, but not when the intercept is constrained to \(0\).
53948512
Three candidate lines are proposed for data on editing passes \(x\) and errors corrected \(y\): A. \(\hat y = 1.0 + 2.0x\) B. \(\hat y = 2.0 + 1.8x\) C. \(\hat y = 0.5 + 2.2x\) The observed data are: <table> <thead><tr><th>Editing passes</th><th>Errors corrected</th></tr></thead> <tbody> <tr><td>1</td><td>3.0</td></tr> <tr><td>2</td><td>5.2</td></tr> <tr><td>3</td><td>7.1</td></tr> <tr><td>4</td><td>8.8</td></tr> <tr><td>5</td><td>11.3</td></tr> </tbody> </table> Compute the sum of squared residuals for each line and identify the best of these three by the least-squares criterion.

Hints

- For each candidate, calculate \(\text{residual} = y - \hat y\) at all five x-values. - Square every residual before adding so positive and negative errors do not cancel. - The least-squares criterion selects the candidate with the smallest total squared residual.

Solution

1. For line A, the residuals are \(0.0, 0.2, 0.1, -0.2, 0.3\), so \(\text{SSR}_A = 0.00 + 0.04 + 0.01 + 0.04 + 0.09 = 0.18\). 2. For line B, the residuals are \(-0.8, -0.4, -0.3, -0.4, 0.3\), so \(\text{SSR}_B = 0.64 + 0.16 + 0.09 + 0.16 + 0.09 = 1.14\). 3. For line C, the residuals are \(0.3, 0.3, 0.0, -0.5, -0.2\), so \(\text{SSR}_C = 0.09 + 0.09 + 0.00 + 0.25 + 0.04 = 0.47\). 4. Line A has the smallest sum of squared residuals, so it is best among the three candidate lines.

Answer

A: \(0.18\); B: \(1.14\); C: \(0.47\). Line A is best among the three because it has the smallest sum of squared residuals.
54796812
The least-squares regression of \(y\) on \(x\) has slope \(1.50\), and the correlation is \(r=0.60\). The same data are then used to fit the least-squares regression of \(x\) on \(y\). Find the slope of the reverse regression. Explain why it is not the reciprocal of \(1.50\).

Hints

- Write the slope relationship once for each choice of response variable. - Compare the product of the two fitted slopes with the correlation. - Think about what would have to be true for the slopes to be exact reciprocals.

Solution

1. The forward slope is \(b_{y\text{ on }x}=r\frac{s_y}{s_x}\), and the reverse slope is \(b_{x\text{ on }y}=r\frac{s_x}{s_y}\). 2. Their product is \(r^2=(0.60)^2=0.36\). 3. Thus \(b_{x\text{ on }y}=\frac{0.36}{1.50}=0.24\). 4. The two slopes are reciprocals only when \(r^2=1\), meaning a perfect linear association.

Answer

The reverse-regression slope is \(0.24\), not \(\frac{1}{1.50}\). Regression is not symmetric unless the linear association is perfect.
54799512
In a least-squares regression fit, one observation has residual \(-4.0\). The model’s current sum of squared residuals is \(52.0\). A student says, “If we remove that observation, the new least-squares fit must have a sum of squared residuals of \(52.0-(-4.0)^2=36.0\).” Evaluate the statement.

Hints

- Distinguish removing one residual contribution from refitting the entire model. - Ask whether the fitted line must stay the same after an observation is deleted. - Remember that all residuals depend on the fitted line, not only on their observed points.

Solution

1. Under the current fitted line, the observation contributes \((-4.0)^2=16.0\) to the sum of squared residuals. 2. Removing that observation would leave a sum of squared residuals of \(36.0\) only if the original fitted line were kept unchanged for the remaining observations. 3. A least-squares regression is refitted after an observation is removed, so the slope and intercept can change and the residuals of the remaining observations can also change. 4. The refitted line cannot have a larger sum of squared residuals than the unchanged original line on the remaining data, so the new sum is at most \(36.0\), but it need not equal \(36.0\).

Answer

The statement is incorrect. The removed observation contributes \(16.0\) to the old sum of squared residuals, but deleting it requires refitting the regression line. The new least-squares sum of squared residuals is at most \(36.0\), but it is not necessarily equal to \(36.0\).
54801812
For a data set, a line forced to pass through the origin is fitted by minimizing squared residuals among all lines of the form \(\hat y=bx\). Its sum of squared residuals is \(50.0\). A second analysis fits the ordinary least-squares regression line \(\hat y=a+bx\), allowing an intercept. Could the second fit have a sum of squared residuals of \(58.0\)? Explain without computing the new line.

Hints

- Compare the set of lines allowed by the two fitting procedures. - Ask whether the first fitted line is still an available candidate in the second procedure. - A minimum over a larger set of choices cannot be worse than the value from one specific available choice.

Solution

1. The ordinary least-squares fit considers all lines of the form \(a+bx\), including the special case \(a=0\). 2. Therefore, the through-origin line with sum of squared residuals \(50.0\) is one candidate available to the ordinary least-squares fit. 3. The minimizing line cannot have a larger sum of squared residuals than an available candidate, so its sum of squared residuals must be at most \(50.0\). 4. A reported value of \(58.0\) is therefore impossible for the ordinary least-squares fit to the same data.

Answer

No. Allowing an intercept gives the least-squares procedure at least all the choices available to the through-origin fit, so the new sum of squared residuals must be \(50.0\) or smaller, not \(58.0\).
54803412
In a data set, every explanatory-variable value equals \(4\), while the response values vary. A student asks for the least-squares regression slope of \(y\) on \(x\). Explain why a unique least-squares slope cannot be determined from these data.

Hints

- Ask what information about change in \(y\) is available when \(x\) never changes. - Think about how many different lines can pass through the same vertical location at \(x=4\). - Check what happens to the explanatory-variable spread in the usual slope formula.

Solution

1. Because every \(x_i=4\), the data contain no horizontal variation with which to estimate how the response changes as \(x\) changes. 2. Any line whose fitted value at \(x=4\) equals the mean response gives the same fitted value for every observation. 3. Infinitely many intercept-slope pairs can produce that same value at \(x=4\), so there is no unique least-squares slope. 4. Equivalently, the usual slope calculation is undefined because the explanatory-variable standard deviation is \(0\).

Answer

A unique slope cannot be estimated because all explanatory values are identical. With no variation in \(x\), many different lines give the same fitted values at \(x=4\), so the regression slope is not identifiable.
54804812
Software reports an ordinary least-squares regression with an intercept. For the response variable, the total sum of squares about \(\bar y\) is \(200\), but the reported sum of squared residuals is \(240\). Can both values be correct for the least-squares fit? Explain using the role of the horizontal line \(\hat y=\bar y\), and compute the reported value of \(1-\frac{SSE}{SST}\).

Hints

- Identify a simple candidate line that is always available when an intercept is allowed. - Compare the candidate line’s squared error with the minimum that least squares is supposed to achieve. - Check the usual relationship between unexplained and total response variation.

Solution

1. The horizontal line \(\hat y=\bar y\) is an available candidate line and has a sum of squared residuals equal to \(SST=200\). 2. The ordinary least-squares line minimizes the sum of squared residuals over all intercept-slope lines, so its \(SSE\) cannot exceed \(200\). 3. The reported \(SSE=240\) is therefore impossible for the least-squares fit with an intercept. 4. The reported ratio would give \(1-\frac{240}{200}=-0.20\), another sign that the values are inconsistent with an ordinary least-squares fit with an intercept.

Answer

No. The least-squares fit must have \(SSE\le200\) because the horizontal mean-response line already achieves \(SSE=200\). The reported values give \(1-\frac{240}{200}=-0.20\), so they are inconsistent with the stated fit.
54810712
A least-squares regression with an intercept is fitted to \(n=20\) observations and has \(SSE=80\). Another line is made by shifting the entire least-squares line upward by \(1.5\) response units without changing its slope. Find the sum of squared errors for the shifted line.

Hints

- Express each new residual in terms of the original residual and the vertical shift. - Expand the squared expression before summing across observations. - Use a standard property of residuals from a least-squares fit with an intercept.

Solution

1. Let the least-squares residuals be \(e_i\). Because the fitted model has an intercept, \(\sum e_i=0\). 2. Shifting the fitted line upward by \(1.5\) changes each residual to \(e_i-1.5\). 3. The new squared-error sum is \(\sum(e_i-1.5)^2=\sum e_i^2-3\sum e_i+20\cdot(1.5)^2\). 4. Using \(\sum e_i=0\) and \(\sum e_i^2=80\), the new value is \(80+20\cdot2.25=125\).

Answer

The shifted line has \(SSE=125\).
54811812
Three observations have explanatory values \(x=1, 2, 3\). Two proposed residual lists are: Set A: \(1, -2, 1\) Set B: \(-1, 0, 1\) For a least-squares line with an intercept, the residuals satisfy both \(\sum e_i=0\) and \(\sum x_ie_i=0\). Which residual set is consistent with both least-squares conditions?

Hints

- Check the ordinary residual sum for each set first. - Then weight each residual by its corresponding explanatory value and add those products. - A set must satisfy both stated conditions, not just one of them.

Solution

1. For Set A, \(1-2+1=0\), and \(1\cdot1+2\cdot(-2)+3\cdot1=0\). 2. For Set B, \(-1+0+1=0\), but \(1\cdot(-1)+2\cdot0+3\cdot1=2\ne0\). 3. Therefore, Set A satisfies both least-squares residual conditions, while Set B satisfies only the zero-sum condition.

Answer

Set A is consistent with both conditions. Set B is not because \(\sum x_ie_i=2\), not \(0\).
54814512
The three points \((0, 0), (1, 1), (2, 0)\) have least-squares line \(\hat y=\frac{1}{3}\). The point \((2, 0)\) is then duplicated once, so the data contain four observations. Does the least-squares line stay the same? Find the new line.

Hints

- Duplicating one point changes its weight relative to the others. - Recompute the sample means before finding the slope. - Use the new mean point to determine the intercept after finding the slope.

Solution

1. In the duplicated data, \(\bar x=1.25\) and \(\bar y=0.25\). 2. The centered cross-product sum is \(-0.25\), and the centered square sum for \(x\) is \(2.75\). 3. Thus the new slope is \(b=\frac{-0.25}{2.75}=-\frac{1}{11}\). 4. The intercept is \(a=0.25-\left(-\frac{1}{11}\right)\cdot1.25=\frac{4}{11}\). 5. Therefore, duplicating only one point changes the fit to \(\hat y=\frac{4}{11}-\frac{1}{11}x\).

Answer

No. The new least-squares line is \(\hat y=\frac{4}{11}-\frac{1}{11}x\), approximately \(\hat y=0.364-0.091x\).
54815812
An ordinary least-squares line with an intercept is fitted to a data set. One observation has residual exactly \(0\). That observation is removed, and the remaining observations still contain at least two distinct \(x\)-values. Must the least-squares slope and intercept change after refitting? Explain.

Hints

- Use the two residual conditions satisfied by an ordinary least-squares fit with an intercept. - Determine what the removed point contributes to those conditions when its residual is zero. - Use the condition on the remaining \(x\)-values to establish uniqueness of the refitted line.

Solution

1. For the original least-squares line, the residuals satisfy \(\sum e_i=0\) and \(\sum x_ie_i=0\). 2. The removed observation contributes \(0\) to both sums because its residual is exactly \(0\). 3. Therefore, the same slope and intercept still satisfy both least-squares normal conditions for the remaining observations. 4. Because the remaining \(x\)-values are not all identical, the least-squares line is unique, so refitting gives the same coefficients.

Answer

No. Under the stated conditions, removing an observation with residual exactly \(0\) leaves the least-squares slope and intercept unchanged.

All problems may be used, copied and printed free of charge for school and tutoring, including paid tutoring. Commercial adaptations as well as publication or redistribution on the internet are not permitted.