- What is Repeated Measures ANOVA?
- Repeated Measures ANOVA Assumptions
- Quick Data Check
- Running Repeated Measures ANOVA in SPSS
- Interpreting the Output
- Reporting Repeated Measures ANOVA

## 1. What is Repeated Measures ANOVA?

SPSS repeated measures ANOVA tests if the means of 3 or more metric variables are all equal in some population. If this is true and we inspect a **sample** from our population, the sample means may differ *a little bit*. Large sample differences, however, are unlikely; these suggest that the population means weren't equal after all.

The simplest repeated measures ANOVA involves 3 outcome variables, all measured on 1 group of cases (often people). Whatever distinguishes these variables (sometimes just the time of measurement) is the **within-subjects factor**.

## Repeated Measures ANOVA Example

A marketeer wants to launch a new commercial and has four concept versions. She shows the four concepts to 40 participants and asks them to rate each one of them on a 10-point scale, resulting in commercial_ratings.sav.Although such ratings are strictly ordinal variables, we'll treat them as metric variables under the assumption of equal intervals. Part of these data are shown below.

The research question is: **which commercial has the highest mean rating?** We'll first just inspect the mean ratings in our sample. We'll then try and generalize this sample outcome to our population by testing the **null hypothesis** that
the 4 population mean scores are all equal.
We'll reject this if our sample means are *very* different. Reversely, our sample means being *slightly* different is a normal sample outcome if population means are all similar.

## 2. Assumptions Repeated Measures ANOVA

Running a statistical test doesn't always make sense; results reflect reality only insofar as relevant assumptions are met. For a (single factor) repeated measures ANOVA these are

**Independent observations**(or, more precisely, independent and identically distributed variables). This is often -not always- satisfied by each case in SPSS representing a different person or other statistical unit.- The test variables follow a
**multivariate normal distribution**in the population. However, this assumption is not needed if the sample size >= 25. **Sphericity**. This means that the population variances of all possible difference scores (com_1 - com_2, com_1 - com_3 and so on) are equal. Sphericity is tested with**Mauchly’s test**which is always included in SPSS’ repeated measures ANOVA output so we'll get to that later.

## 3. Quick Data Check

Before jumping blindly into statistical tests, let's first get a rough idea of what the data look like. Do the frequency distributions look plausible? Are there any system missing values or user missing values that we need to define? For quickly answering such questions, we'll open the data and run histograms with the syntax below.

***Run histograms for 4 variables without frequency tables.**

frequencies com_1 to com_4

/format notable

/histogram.

## Result

First off, **our histograms look plausible** and don't show any weird patterns or extreme values. There's no need to exclude any cases or define user missing values.

Second, since n = 40 for all variables, we don't have any system missing values. In this case, we can proceed with confidence.

## 4. Run SPSS Repeated Measures ANOVA

We may freely choose a name for our **within-subjects factor**. We went with “commercial” because it's the commercial that differs between the four ratings made by each respondent.

We may also choose a name for our **measure**: whatever each of the four variables is supposed to reflect. In this case we simply chose “rating”.

We now select all four variables and move them to the

Under we'll select .

Clicking results in the syntax below.

***Basic Repeated-Measures ANOVA Syntax.**

GLM com_1 com_2 com_3 com_4

/WSFACTOR=commercial 4 Polynomial

/MEASURE=rating

/METHOD=SSTYPE(3)

/PRINT=DESCRIPTIVE

/CRITERIA=ALPHA(.05)

/WSDESIGN=commercial.

## 5. Repeated Measures ANOVA Output - Descriptives

First off, we take a look at the **Descriptive Statistics** table shown below. Commercial 4 was rated best (m = 6.25). Commercial 1 was rated worst (m = 4.15). Given our 10-point scale, these are large differences.

## Repeated Measures ANOVA Output - Mauchly’s Test

We now turn to Mauchly's test for the sphericity assumption. As a rule of thumb, **sphericity is assumed if Sig. > 0.05**. For our data, Sig. = 0.54 so sphericity is no issue here.

The amount of sphericity is estimated by **epsilon** (the Greek letter ‘e’ and written as ε). There are different ways for estimating it, including the Greenhouse-Geisser, Huynh-Feldt and lower bound methods. If sphericity is violated, these are used to correct the within-subjects tests as we'll see below.If sphericity is very badly violated, we may report the Multivariate Tests table or abandon repeated measures ANOVA altogether in favor of a Friedman test.

## Repeated Measures ANOVA Output - Within-Subjects Effects

Since our data seem spherical, we'll ignore the Greenhouse-Geisser, Huynh-Feldt and lower bound results in the table below. We'll simply interpret the uncorrected results denoted as “**Sphericity Assumed**”.

The **Tests of Within-Subjects Effects** is our core output. Because we've just one factor (which commercial was rated), it's pretty simple.

Our significance level, **Sig. = .000**. So if the means are perfectly equal in the population, there's a 0% chance of finding the differences between the means that we observe in the sample. We therefore reject the null hypothesis of equal means.

The F-value is not really interesting but we'll report it anyway. The same goes for the effect degrees of freedom (df1) and the error degrees of freedom (df2).

## 6. Reporting the Measures ANOVA Result

When reporting a basic repeated-measures ANOVA, we usually report

- the
**descriptive statistics**table - the outcome of
**Mauchly's test**and - the outcome of the
**within-subjects tests**.

When reporting corrected results (Greenhouse-Geisser, Huynh-Feldt or lower bound), indicate which of these corrections you used. We'll cover this in SPSS Repeated Measures ANOVA - Example 2.

Finally, the main F-test is reported as
*“The four commercials were not rated equally, F(3,117) = 15.4, p = .000.”*

Thank you for reading!

## This tutorial has 17 comments

## By zarghuna naseem on August 6th, 2016

The examples have been described in an easy manner. A person can easily understand the concept.

## By Ruben Geert van den Berg on May 10th, 2016

Hi Laura!

You mean that SPSS has frozen, right? Did you try to close the program entirely (perhaps even restart your computer) and try again? If so, then perhaps your license has expired? You can find out by running

SHOW LICENSE.

unless everything is so stuck that even that doesn't work anymore.

Are you seeing anything in SPSS' status bar (other than "IBM SPSS Statistics Processor is Ready)?

## By Laura on May 10th, 2016

I can't click paste, can't do anything.

## By Ruben Geert van den Berg on January 26th, 2016

Basically, sphericity being met results in the F-statistic actually following its theoretical F distribution, implying that the p-value closely approximates the actual p-value.

Generally, if statistical assumptions are violated, then the test statistics don't follow the distributions they're (theoretically) supposed to follow. The actual (empirical) distributions can be shown by running a simulation (run some test 1,000 times, draw a histogram of the test statistic values and see whether it approximates the theoretical distribution.

I briefly presented such a simulation for explaining how ANOVA actually works. It that doesn't clear things up a lot, then I did a lousy job on that one ;-)

## By CARLA MATHIS on January 25th, 2016

Awesome tutorial. What affect does sphericity being met have on the p-value?]