Thumbtacks - Introduction
It begins with this form (Inference for Proportions) and handing out one thumbtack. In their own brain, students decide what they think it is and what it would take to convince them it was wrong. Then they toss the tack to be able to compare their observations to a model they've developed. Sounds a lot like your entire hypothesis testing/inferential statistics unit.
The NCAA Basketball Tournament - A Basic Example
Kids then made predictions for the NCAA tournament and we tested just how good they were at doing so by comparing their proportion of correct first round picks to randomly guessing (p = 0.5). A big question that came up was "Are we just doing this for the first round?" and in true teacher fashion I said, "Yes. Now how come we're only doing it for the first round?" Cue a killer discussion about large enough sample sizes and the Success/Failure condition.
Back to Thumbtacks - Put it into practice
Fire up the laptops and open up what the rest of your classmates thought (What They Thought). Immediately they began to think "Why did this kid think they were incorrect when they got a lower proportion that what they thought they needed to be incorrect?"...a not so formalized way to think about a standard of proof and a low enough p-value to reject the null hypothesis. This was one of those points in class where I said nothing and let their brains piece together what they were looking at. I clarified what we were looking at, asked them to pick case that they thought was theirs and test the original hypothesis.
On the board, write your p-value and whether or not you rejected your original hypothesis. As a class we'll have a look at everyone's p-values and decisions, then decide who has correctly rejected/not rejected. They all argue about what p-value is considered "low enough" that you have to reject. One of those moments where again, I say nothing and they develop an understanding of alpha-levels. Not so formal...yet.
Pick another one of those contexts from the Inference for Proportions form and investigate it. I think I'm going to add some more situations/contexts. I'm also not sure that they ever need to fill out that form more than once...
What's Left to Do?
1. So what really is the true proportion (Confidence Intervals)
2. Is what we got really that different? (two proportions)
3. Repeat procedure for sample means instead of proportions
Feel free to go to our class wiki for any supplemental exercises/materials.