# AP Statistics Curriculum 2007 Infer BiVar

### From Socr

(→Comparing Two Variances (\sigma_1^2 = \sigma_2^2?)) |
|||

(13 intermediate revisions not shown) | |||

Line 1: | Line 1: | ||

==[[AP_Statistics_Curriculum_2007 | General Advance-Placement (AP) Statistics Curriculum]] - Comparing Two Variances== | ==[[AP_Statistics_Curriculum_2007 | General Advance-Placement (AP) Statistics Curriculum]] - Comparing Two Variances== | ||

- | In the [[AP_Statistics_Curriculum_2007_Hypothesis_Var | section on inference about the variance and the standard deviation]] we already learned how to do inference on either of these two population | + | In the [[AP_Statistics_Curriculum_2007_Hypothesis_Var | section on inference about the variance and the standard deviation]], we already learned how to do inference on either of these two population parameters. Now we discuss the comparison of the variances (or standard deviations) using data randomly sampled from two different populations. |

=== [[AP_Statistics_Curriculum_2007_Estim_Var | Background]]=== | === [[AP_Statistics_Curriculum_2007_Estim_Var | Background]]=== | ||

Line 9: | Line 9: | ||

: <math>\chi_o^2 = {(n-1)s^2 \over \sigma^2} \sim \Chi_{(df=n-1)}^2</math> | : <math>\chi_o^2 = {(n-1)s^2 \over \sigma^2} \sim \Chi_{(df=n-1)}^2</math> | ||

- | ===Comparing Two Variances ( | + | ===Comparing Two Variances (\(\sigma_1^2 = \sigma_2^2\)?)=== |

- | Suppose we study two populations which are approximately | + | Suppose we study two populations which are approximately Normally distributed, and we take a random sample from each population, {<math>X_1, X_2, X_3, \cdots, X_n</math>} and {<math>Y_1, Y_2, Y_3, \cdots, Y_k</math>}. Recall that <math>{(n-1) s_1^2 \over \sigma_1^2}</math> and <math>{(n-1) s_2^2 \over \sigma_2^2}</math> have <math>\Chi^2_{(df=n - 1)}</math> and <math>\Chi^2_{(df=k - 1)}</math> distributions. We are interested in assessing <math>H_o: \sigma_1^2 = \sigma_2^2</math> vs. <math>H_1: \sigma_1^2 \not= \sigma_2^2</math>, where <math>s_1</math> and <math>\sigma_1</math>, and <math>s_2</math> and <math>\sigma_2</math> and the sample and the population standard deviations for the two populations/samples, respectively. |

- | |||

- | + | Notice that the [http://mathworld.wolfram.com/Chi-SquaredDistribution.html Chi-Square Distribution] is not symmetric (it is positively skewed). You can visualize the Chi-Square distribution and compute all critical values either using the [http://socr.ucla.edu/htmls/SOCR_Distributions.html SOCR Chi-Square Distribution] or using the [http://socr.ucla.edu/Applets.dir/Normal_T_Chi2_F_Tables.htm SOCR Chi-Square Distribution Calculator]. | |

- | + | ||

- | The | + | The [http://mathworld.wolfram.com/F-Distribution.html Fisher's F Distribution], and the corresponding F-test, is used to test if the variances of two populations are equal. Depending on the alternative hypothesis, we can use either a two-tailed test or a one-tailed test. The two-tailed version tests against an alternative that the standard deviations are not equal (<math>H_1: \sigma_1^2 \not= \sigma_2^2</math>). The one-tailed version only tests in one direction (<math>H_1: \sigma_1^2 < \sigma_2^2</math> or <math>H_1: \sigma_1^2 > \sigma_2^2</math>). The choice is determined by the [[AP_Statistics_Curriculum_2007_IntroDesign | study design]] before any data is analyzed. For example, if a modification to an existent medical treatment is proposed, we may only be interested in knowing if the new treatment is more consistent and less variable than the established medical intervention. |

+ | |||

+ | * Test Statistic: <math>F_o = {\sigma_1^2 \over \sigma_2^2}</math> | ||

+ | The farther away this ratio is from 1, the stronger the evidence for unequal population variances. | ||

* Inference: Suppose we test at significance level <math>\alpha=0.05</math>. Then the hypothesis that the two standard deviations are equal is rejected if the test statistics is outside this interval | * Inference: Suppose we test at significance level <math>\alpha=0.05</math>. Then the hypothesis that the two standard deviations are equal is rejected if the test statistics is outside this interval | ||

Line 24: | Line 26: | ||

: <math>H_1: \sigma_1^2 < \sigma_2^2</math>: If <math>F_o < F(1-\alpha,df_1=n_1-1,df_2=n_2-1)</math> | : <math>H_1: \sigma_1^2 < \sigma_2^2</math>: If <math>F_o < F(1-\alpha,df_1=n_1-1,df_2=n_2-1)</math> | ||

- | : <math>H_1: \sigma_1^2 \not= \sigma_2^2</math>: If <math>F_o < F(1-\alpha/2,df_1=n_1-1,df_2=n_2-1)</math> or <math>F_o > F(\alpha/2,df_1=n_1-1,df_2=n_2-1)</math>, | + | : <math>H_1: \sigma_1^2 \not= \sigma_2^2</math>: If either <math>F_o < F(1-\alpha/2,df_1=n_1-1,df_2=n_2-1)</math> or <math>F_o > F(\alpha/2,df_1=n_1-1,df_2=n_2-1)</math>, |

- | + | ||

where <math>F(\alpha,df_1=n_1-1,df_2=n_2-1)</math> is the critical value of the [http://socr.ucla.edu/htmls/SOCR_Distributions.html F distribution] with ''degrees of freedom for the numerator and denominator'', <math>df_1=n_1-1,df_2=n_2-1</math>, respectively. | where <math>F(\alpha,df_1=n_1-1,df_2=n_2-1)</math> is the critical value of the [http://socr.ucla.edu/htmls/SOCR_Distributions.html F distribution] with ''degrees of freedom for the numerator and denominator'', <math>df_1=n_1-1,df_2=n_2-1</math>, respectively. | ||

- | In the image below the left and right critical regions are white with <math>F(\alpha,df_1=n_1-1,df_2=n_2-1)</math> and <math>F(1-\alpha,df_1=n_1-1,df_2=n_2-1)</math> representing the lower and upper, respectively, critical values. In this example of <math>F(df_1=12, df_2=15)</math>, the left and right critical values at <math>\alpha/2=0.025</math> are <math>F(\alpha/2=0.025,df_1=9,df_2=14)=0.314744</math> and <math>F(1-\alpha/2=0.975,df_1=9,df_2=14)=2.96327</math>, respectively. | + | |

+ | In the image below, the left and right critical regions are white with <math>F(\alpha,df_1=n_1-1,df_2=n_2-1)</math> and <math>F(1-\alpha,df_1=n_1-1,df_2=n_2-1)</math> representing the lower and upper, respectively, critical values. In this example of <math>F(df_1=12, df_2=15)</math>, the left and right critical values at <math>\alpha/2=0.025</math> are <math>F(\alpha/2=0.025,df_1=9,df_2=14)=0.314744</math> and <math>F(1-\alpha/2=0.975,df_1=9,df_2=14)=2.96327</math>, respectively. | ||

<center>[[Image:SOCR_EBook_Dinov_Infer_BiVar_021608_Fig1.jpg|500px]]</center> | <center>[[Image:SOCR_EBook_Dinov_Infer_BiVar_021608_Fig1.jpg|500px]]</center> | ||

- | |||

- | |||

- | |||

- | + | ===Comparing Two Standard Deviations (<math>\sigma_1 = \sigma_2</math>?)=== | |

+ | To make inference on whether the standard deviations of two populations are equal, we calculate the sample variances and apply the inference on the ratio of the sample variance using the F-test, as described above. | ||

===Hands-on activities=== | ===Hands-on activities=== | ||

- | * Formulate appropriate hypotheses and assess the significance of the evidence to reject the null hypothesis | + | * Formulate appropriate hypotheses and assess the significance of the evidence to reject the null hypothesis that the variances of the two populations, where the following data come from, are distinct. Assume the observations below represent random samples (of sizes 6 and 10) from two Normally distributed populations of liquid content (in fluid ounces) of beverage cans. Use (<math>\alpha=0.1</math>). |

<center> | <center> | ||

{| class="wikitable" style="text-align:center; width:75%" border="1" | {| class="wikitable" style="text-align:center; width:75%" border="1" | ||

|- | |- | ||

- | | 14.816 || 14.863 || 14.814 || 14.998 || 14.965 || 14.824 || 14.884 || 14.838 || 14.916 || 15.021 || 14.874 || 14.856 || 14.860 || 14.772 || 14.980 || 14.919 | + | | '''Sample from Population 1''' || 14.816 || 14.863 || 14.814 || 14.998 || 14.965 || 14.824 || || || || |

+ | |- | ||

+ | | '''Sample from Population 2'''|| 14.884 || 14.838 || 14.916 || 15.021 || 14.874 || 14.856 || 14.860 || 14.772 || 14.980 || 14.919 | ||

|} | |} | ||

</center> | </center> | ||

- | * Hypotheses: <math>H_o: \ | + | * Hypotheses: <math>H_o: \sigma_1 = \sigma_2</math> vs. <math>H_1: \sigma_1 \not= \sigma_2</math> . |

- | * Get the sample statistics from [http://socr.ucla.edu/htmls/SOCR_Charts.html SOCR Charts] (e.g., Index Plot); | + | * Get the sample statistics from [http://socr.ucla.edu/htmls/SOCR_Charts.html SOCR Charts] (e.g., Index Plot); |

- | + | <center> | |

+ | {| class="wikitable" style="text-align:center; width:25%" border="1" | ||

+ | |- | ||

+ | | || Sample Mean || Sample SD || Sample Variance | ||

+ | |- | ||

+ | | '''Sample 1''' || 14.88 || 0.081272382 || 0.0066052 | ||

+ | |- | ||

+ | | '''Sample 2'''|| 14.892 || 0.071269442 || 0.005079333 | ||

+ | |} | ||

+ | </center> | ||

- | + | <center>[[Image:SOCR_EBook_Dinov_Infer_BiVar_021608_Fig2.jpg|500px]]</center> | |

- | * | + | * Identify the degrees of freedom (<math>df_1=6-1=5</math> and <math>df_2=10-1=9</math>). |

- | * | + | * Test Statistics: <math>F_o = {\sigma_1^2 \over \sigma_2^2}=1.300406878</math> |

- | + | ||

- | < | + | * Significance Inference: P-value=<math>P(F_{(df_1=5, df_2=9)} > F_o) = 0.328147</math>. This p-value does not indicate strong evidence in the data to reject the null hypothesis. That is, the data does not have power to discriminate between the population variances of the two populations based on these (small) samples. |

- | + | <center>[[Image:SOCR_EBook_Dinov_Infer_BiVar_021608_Fig3.jpg|500px]]</center> | |

- | + | ===More examples=== | |

- | + | ||

- | + | ||

- | + | ||

- | + | ||

- | + | ||

- | + | ||

- | * | + | * Use the [[SOCR_012708_ID_Data_HotDogs | hot-dogs dataset]] to formulate and test hypotheses about the difference of the population standard deviations of sodium between the poultry and the meet based hot-dogs. Repeat this with variances of calories between the beef and meet based hot-dogs. |

- | + | ===See also=== | |

+ | [[AP_Statistics_Curriculum_2007_NonParam_VarIndep | Fligner-Killeen non-parametric test for variance homogeneity]]. | ||

<hr> | <hr> | ||

===References=== | ===References=== | ||

- | |||

<hr> | <hr> |

## Current revision as of 14:44, 14 February 2014

## Contents |

## General Advance-Placement (AP) Statistics Curriculum - Comparing Two Variances

In the section on inference about the variance and the standard deviation, we already learned how to do inference on either of these two population parameters. Now we discuss the comparison of the variances (or standard deviations) using data randomly sampled from two different populations.

### Background

Recall that the sample-variance (s^{2}) is an unbiased point estimate for the population variance σ^{2}, and similarly, the sample-standard-deviation (*s*) is a point estimate for the population-standard-deviation σ.

The sample-variance is roughly Chi-square distributed:

### Comparing Two Variances (\(\sigma_1^2 = \sigma_2^2\)?)

Suppose we study two populations which are approximately Normally distributed, and we take a random sample from each population, {} and {}. Recall that and have and distributions. We are interested in assessing vs. , where *s*_{1} and σ_{1}, and *s*_{2} and σ_{2} and the sample and the population standard deviations for the two populations/samples, respectively.

Notice that the Chi-Square Distribution is not symmetric (it is positively skewed). You can visualize the Chi-Square distribution and compute all critical values either using the SOCR Chi-Square Distribution or using the SOCR Chi-Square Distribution Calculator.

The Fisher's F Distribution, and the corresponding F-test, is used to test if the variances of two populations are equal. Depending on the alternative hypothesis, we can use either a two-tailed test or a one-tailed test. The two-tailed version tests against an alternative that the standard deviations are not equal (). The one-tailed version only tests in one direction ( or ). The choice is determined by the study design before any data is analyzed. For example, if a modification to an existent medical treatment is proposed, we may only be interested in knowing if the new treatment is more consistent and less variable than the established medical intervention.

- Test Statistic:

The farther away this ratio is from 1, the stronger the evidence for unequal population variances.

- Inference: Suppose we test at significance level α = 0.05. Then the hypothesis that the two standard deviations are equal is rejected if the test statistics is outside this interval

- : If
*F*_{o}>*F*(α,*d**f*_{1}=*n*_{1}− 1,*d**f*_{2}=*n*_{2}− 1)

- : If
*F*_{o}<*F*(1 − α,*d**f*_{1}=*n*_{1}− 1,*d**f*_{2}=*n*_{2}− 1)

- : If either
*F*_{o}<*F*(1 − α / 2,*d**f*_{1}=*n*_{1}− 1,*d**f*_{2}=*n*_{2}− 1) or*F*_{o}>*F*(α / 2,*d**f*_{1}=*n*_{1}− 1,*d**f*_{2}=*n*_{2}− 1),

where *F*(α,*d**f*_{1} = *n*_{1} − 1,*d**f*_{2} = *n*_{2} − 1) is the critical value of the F distribution with *degrees of freedom for the numerator and denominator*, *d**f*_{1} = *n*_{1} − 1,*d**f*_{2} = *n*_{2} − 1, respectively.

In the image below, the left and right critical regions are white with *F*(α,*d**f*_{1} = *n*_{1} − 1,*d**f*_{2} = *n*_{2} − 1) and *F*(1 − α,*d**f*_{1} = *n*_{1} − 1,*d**f*_{2} = *n*_{2} − 1) representing the lower and upper, respectively, critical values. In this example of *F*(*d**f*_{1} = 12,*d**f*_{2} = 15), the left and right critical values at α / 2 = 0.025 are *F*(α / 2 = 0.025,*d**f*_{1} = 9,*d**f*_{2} = 14) = 0.314744 and *F*(1 − α / 2 = 0.975,*d**f*_{1} = 9,*d**f*_{2} = 14) = 2.96327, respectively.

### Comparing Two Standard Deviations (σ_{1} = σ_{2}?)

To make inference on whether the standard deviations of two populations are equal, we calculate the sample variances and apply the inference on the ratio of the sample variance using the F-test, as described above.

### Hands-on activities

- Formulate appropriate hypotheses and assess the significance of the evidence to reject the null hypothesis that the variances of the two populations, where the following data come from, are distinct. Assume the observations below represent random samples (of sizes 6 and 10) from two Normally distributed populations of liquid content (in fluid ounces) of beverage cans. Use (α = 0.1).

Sample from Population 1 | 14.816 | 14.863 | 14.814 | 14.998 | 14.965 | 14.824 | ||||

Sample from Population 2 | 14.884 | 14.838 | 14.916 | 15.021 | 14.874 | 14.856 | 14.860 | 14.772 | 14.980 | 14.919 |

- Hypotheses:
*H*_{o}:σ_{1}= σ_{2}vs. .

- Get the sample statistics from SOCR Charts (e.g., Index Plot);

Sample Mean | Sample SD | Sample Variance | |

Sample 1 | 14.88 | 0.081272382 | 0.0066052 |

Sample 2 | 14.892 | 0.071269442 | 0.005079333 |

- Identify the degrees of freedom (
*d**f*_{1}= 6 − 1 = 5 and*d**f*_{2}= 10 − 1 = 9).

- Test Statistics:

- Significance Inference: P-value=. This p-value does not indicate strong evidence in the data to reject the null hypothesis. That is, the data does not have power to discriminate between the population variances of the two populations based on these (small) samples.

### More examples

- Use the hot-dogs dataset to formulate and test hypotheses about the difference of the population standard deviations of sodium between the poultry and the meet based hot-dogs. Repeat this with variances of calories between the beef and meet based hot-dogs.

### See also

Fligner-Killeen non-parametric test for variance homogeneity.

### References

- SOCR Home page: http://www.socr.ucla.edu

Translate this page: