In the example of two exam versions, the teacher would like to evaluate whether there is convincing evidence that the difference in average scores between the two exams is not due to chance.
It will be useful to extend the distribution method from Section 3.3 to apply to a difference of means:
Our procedure for checking conditions mirrors what we did for large samples in Section 3.2. First, we verify the small sample conditions (independence and nearly normal data) for each sample separately, then we verify that the samples are also independent. For instance, if the teacher believes students in her class are independent, the exam scores are nearly normal, and the students taking each version of the exam were independent, then we can use the distribution for inference on the point estimate .
The formula for the standard error of , introduced in Section 3.2, also applies to small samples:
(3.3) |
Because we will use the distribution, we will need to identify the appropriate degrees of freedom. This can be done using computer software. An alternative technique is to use the smaller of and , which is the method we will apply.3535This technique for degrees of freedom is conservative with respect to a Type 1 Error; it is more difficult to reject the null hypothesis using this method.
Using the distribution for a difference in means
The distribution can be used for inference when working with the standardized difference of two
means if (1) each sample meets the conditions for using the distribution and (2) the samples
are independent. We estimate the standard error of the difference of two means using
Equation (3.3).