# AP Statistics Curriculum 2007 ANOVA 2Way

(Difference between revisions)
 Revision as of 19:25, 21 February 2008 (view source)IvoDinov (Talk | contribs)← Older edit Revision as of 01:06, 22 February 2008 (view source)IvoDinov (Talk | contribs) Newer edit → Line 6: Line 6: Suppose we want to study the dynamics of the [http://en.wikipedia.org/wiki/Consumer_price_index US Consumer Price Index (CPI)], which is a major economic indicator that measures the average price changes of consumer goods and services. Suppose we want to study the dynamics of the [http://en.wikipedia.org/wiki/Consumer_price_index US Consumer Price Index (CPI)], which is a major economic indicator that measures the average price changes of consumer goods and services. - To motivate 2-way ANOVA we can focus on a 5-year annual summaries of the CPI for different types of consumer good (items). The [[SOCR_Data_Dinov_021808_ConsumerPriceIndex2Way | complete dataset can be found here]] and a small 5-year exherp is included below. Clearly, we have two-factors that may explain the dynamics of the CPI - ''year'' and ''item-type''. + To motivate 2-way ANOVA we can focus on a 5-year annual summary of the CPI for different types of consumer good (items). The [[SOCR_Data_Dinov_021808_ConsumerPriceIndex2Way | complete dataset can be found here]] and a small 5-year excerpt is included below. Clearly, we have two-factors that may explain the dynamics of the CPI - ''year'' and ''item-type''.
Line 58: Line 58: {| class="wikitable" style="text-align:center; width:30%" border="1" {| class="wikitable" style="text-align:center; width:30%" border="1" |- |- - | A || 26.2,24.3,21.8,28.1 + | '''Year''' || '''Food''' || '''Housing''' || '''Transportation''' || '''MedicalCare''' |- |- - | B || 29.2,28.1,27.3,31.2 + | 2003 || 180.5 || 184.8 || 157.6 || 297.1 |- |- - | C || 29.1,30.8,33.9,32.8 + | 2004 || 186.6 || 189.5 || 163.1 || 310.1 |- |- - | D || 21.3,22.4,24.3,21.8 + | 2005 || 191.2 || 195.7 || 173.9 || 323.2 |- |- - | E || 20.1,19.3,19.9,22.1 + | 2006 || 195.7 || 203.2 || 180.9 || 336.2 + |- + | 2007 || 203.3 || 209.586 || 184.682 || 351.054 |} |}
Line 109: Line 111: ====Interaction Effect==== ====Interaction Effect==== - The interaction effect is the effect that one factor has on the other factor. The degrees of freedom here is the product of the two degrees of freedom for each factor. + The interaction effect is the effect that one factor has on the other factor. The degree of freedom here is the product of the two degrees of freedom for each factor. ====Within Variation==== ====Within Variation==== Line 118: Line 120: ====Two-Way ANOVA Table==== ====Two-Way ANOVA Table==== - It is assumed that main effect A has ''a'' levels (and df(A) = a-1), main effect B has ''b'' levels (and (df(B) = b-1), ''r'' is the sample size of each treatment, and $N = a\times b\times n$ is the total sample size. Notice the overall degrees of freedom is once again one less than the total sample size. + It is assumed that main effect A has ''a'' levels (and df(A) = a-1), main effect B has ''b'' levels (and (df(B) = b-1), ''r'' is the sample size of each treatment, and $N = a\times b\times n$ is the total sample size. Notice the overall degree of freedom is once again one less than the total sample size.

## General Advance-Placement (AP) Statistics Curriculum - Two-Way Analysis of Variance (ANOVA)

In the previous section, we discussed statistical inference in comparing k independent samples separated by a single (grouping) factor. Now we will discuss variance decomposition of data into (independent/orthogonal) components when we have two (grouping) factors. Hence, this procedure called Two-Way Analysis of Variance.

### Motivational Example

Suppose we want to study the dynamics of the US Consumer Price Index (CPI), which is a major economic indicator that measures the average price changes of consumer goods and services.

To motivate 2-way ANOVA we can focus on a 5-year annual summary of the CPI for different types of consumer good (items). The complete dataset can be found here and a small 5-year excerpt is included below. Clearly, we have two-factors that may explain the dynamics of the CPI - year and item-type.

 Variety of Pea Year CPI-Value Item-Code Year-Code Item 2003 180.5 1 1 Food 2003 184.8 2 1 Housing 2003 157.6 3 1 Transportation 2003 297.1 4 1 MedicalCare 2004 186.6 1 2 Food 2004 189.5 2 2 Housing 2004 163.1 3 2 Transportation 2004 310.1 4 2 MedicalCare 2005 191.2 1 3 Food 2005 195.7 2 3 Housing 2005 173.9 3 3 Transportation 2005 323.2 4 3 MedicalCare 2006 195.7 1 4 Food 2006 203.2 2 4 Housing 2006 180.9 3 4 Transportation 2006 336.2 4 4 MedicalCare 2007 203.3 1 5 Food 2007 209.586 2 5 Housing 2007 184.682 3 5 Transportation 2007 351.054 4 5 MedicalCare

 Year Food Housing Transportation MedicalCare 2003 180.5 184.8 157.6 297.1 2004 186.6 189.5 163.1 310.1 2005 191.2 195.7 173.9 323.2 2006 195.7 203.2 180.9 336.2 2007 203.3 209.586 184.682 351.054

Using the SOCR Charts (see SOCR Box-and-Whisker Plot Activity and Dot Plot Activity), we can generate plots that enable us to compare visually the yields of the 5 different types peas.

### Two-Way ANOVA Calculations

Let's make the following notation:

Two-way Model: yi,j,k = μ + τi + βj + γi,j + εi,j,k, for all $1\leq i\leq a$, $1\leq j\leq b$ and $1\leq k\leq r$. Here μ is the overall mean response, τi is the effect due to the ith level of factor A, βj is the effect due to the jth level of factor B and γi,j is the effect due to any interaction between the ith level of factor A and the jth level of factor B.
yi,j,k = the A-factor level i and B-factor level j, observation-index k measurement.
k = number of replicates.
ai = number of A-factor observations at level i, $a= a_1 + a_2 + \cdots + a_I$.
bj = number of B-factor observations at level j, $b= b_1 + b_2 + \cdots + b_J$.
N = total number of observations, $N=a\times a \times b$.
The mean of the A-factor group mean at level i and B-factor at level j is: $\bar{y}_{i,j,.} = {\sum_{k=1}^{r}{y_{i,j,k}} \over r}$
The grand mean is: $\bar{y}=\bar{y}_{.,.,.} = {\sum_{k=1}^r{\sum_{i=1}^a {\sum_{j=1}^{b}{y_{i,j,k}}}} \over N}$.

When an $a \times b$ factorial experiment is conducted with an equal number of observation per treatment combination, and where AB represents the interaction between A and B, the total (corrected) sum of squares is partitioned as:

SS(Total) = SS(A) + SS(B) + SS(AB) + SSE

### Hypotheses

There are three sets of hypotheses with the two-way ANOVA.

#### The null hypotheses for each of the sets

• The population means of the first factor are equal. This is like the one-way ANOVA for the row factor.
• The population means of the second factor are equal. This is like the one-way ANOVA for the column factor.
• There is no interaction between the two factors. This is similar to performing a test for independence with contingency tables.

#### Factors

The two independent variables in a two-way ANOVA are called factors (denoted by A and B). The idea is that there are two variables, factors, which affect the dependent variable (Y). Each factor will have two or more levels within it, and the degrees of freedom for each factor is one less than the number of levels.

#### Treatment Groups

Treatement Groups are formed by making all possible combinations of the two factors. For example, if the first factor has 5 levels and the second factor has 6 levels, then there will be $5\times6=30$ different treatment groups.

#### Main Effect

The main effect involves the independent variables one at a time. The interaction is ignored for this part. Just the rows or just the columns are used, not mixed. This is the part which is similar to the one-way analysis of variance. Each of the variances calculated to analyze the main effects are like the between variances

#### Interaction Effect

The interaction effect is the effect that one factor has on the other factor. The degree of freedom here is the product of the two degrees of freedom for each factor.

#### Within Variation

The Within variation is the sum of squares within each treatment group. You have one less than the sample size (remember all treatment groups must have the same sample size for a two-way ANOVA) for each treatment group. The total number of treatment groups is the product of the number of levels for each factor. The within variance is the within variation divided by its degrees of freedom. The within group is also called the error.

#### F-Tests

There is an F-test for each of the hypotheses, and the F-test is the mean square for each main effect and the interaction effect divided by the within variance. The numerator degrees of freedom come from each effect, and the denominator degrees of freedom is the degrees of freedom for the within variance in each case.

#### Two-Way ANOVA Table

It is assumed that main effect A has a levels (and df(A) = a-1), main effect B has b levels (and (df(B) = b-1), r is the sample size of each treatment, and $N = a\times b\times n$ is the total sample size. Notice the overall degree of freedom is once again one less than the total sample size.

 Variance Source Degrees of Freedom (df) Sum of Squares (SS) Mean Sum of Squares (MS) F-Statistics P-value Main Effect A df(A)=a-1 $SS(A)=r\times b\times\sum_{i=1}^{a}{(\bar{y}_{i,.,.}-\bar{y})^2}$ ${SS(A)\over df(A)}$ $F_o = {MS(A)\over MSE}$ P(F(df(A),df(E)) > Fo) Main Effect B df(B)=b-1 $SS(B)=r\times a\times\sum_{j=1}^{b}{(\bar{y}_{., j,.}-\bar{y})^2}$ ${SS(B)\over df(B)}$ $F_o = {MS(B)\over MSE}$ P(F(df(B),df(E)) > Fo) A vs.B Interaction df(AB)=(a-1)(b-1) $SS(AB)=r\times \sum_{i=1}^{a}{\sum_{j=1}^{b}{((\bar{y}_{i, j,.}-\bar{y}_{i, .,.})+(\bar{y}_{., j,.}-\bar{y}))^2}}$ ${SS(AB)\over df(AB)}$ $F_o = {MS(AB)\over MSE}$ P(F(df(AB),df(E)) > Fo) Error $N-a\times b$ $SSE=\sum_{k=1}^r{\sum_{i=1}^{a}{\sum_{j=1}^{b}{(\bar{y}_{i, j,k}-\bar{y}_{i, j,.})^2}}}$ ${SSE\over df(Error)}$ Total N-1 $SST=\sum_{k=1}^r{\sum_{i=1}^{a}{\sum_{j=1}^{b}{(\bar{y}_{i, j,k}-\bar{y}_{., .,.})^2}}}$ ANOVA Activity

To compute the difference between the means, we will compare each group mean to the grand mean.

### SOCR ANOVA Calculations

SOCR Analyses provide the tools to compute the 1-way ANOVA. For example, the ANOVA for the peas data above may be easily computed - see the image below. Note that SOCR ANOVA requires the data to be entered in this format:

### Two-Way ANOVA Conditions

The Two-way ANOVA is valid if:

• The populations from which the samples were obtained must be normally or approximately normally distributed.
• The samples must be independent.
• The variances of the populations must be equal.
• The groups must have the same sample size.