Carlisle Rainey
It’s helpful to think of statistical power as determined by the ratio , where is the treatment effect and SE is the standard error of the estimate.1 1 Bloom (1995) has a really beautiful paper on this idea. It’s one of my favorites. I also have a preprint on the topic.I like this ratio because it...
Carlisle Rainey
Power Rules This post is based on this paper called “Power Rules.” We can think of statistical power as determined by the ratio , where is the treatment effect and SE is the standard error of the estimate. To reason about statistical power, one needs to make assumptions or predictions about...
Carlisle Rainey
We can think of statistical power as determined by the ratio , where is the treatment effect and SE is the standard error of the estimate.1 To reason about statistical power, one needs to make assumptions or predictions about the treatment effect and the standard error. 1 Bloom (1995) has a...
Carlisle Rainey
Background on arguing for a negligible effect I remember sitting in a talk while I was a graduate student, and the speaker said something like: “I expect no effect here, and, just as I expected, the difference is not statistically significant.” Of course, that’s not a compelling argument for a...
Carlisle Rainey
A Paper This post turned out to be somewhat popular, so I’ve written up a more formal, careful description of the idea in a full-length paper. You can find the preprint “Power Rules” here. Background I’ve wrapped up the argument that you should pursue statistical power in your experiments....
Carlisle Rainey
Background When I give students formula for confidence intervals, I find that students don’t have a sharp concept of how those confidence intervals work—even if I explain the components of the formula well. Even though they understand—seemingly very well—that the point estimate is noisy, they...
Carlisle Rainey
A Paper This post turned out to be somewhat popular, so I’ve written up a more formal, careful description of the idea in a full-length paper. You can find the preprint “Power Rules” here. Background In this post, I address confidence intervals that are nestled right up against zero.1 These...
Carlisle Rainey
A Paper This post turned out to be somewhat popular, so I’ve written up a more formal, careful description of the idea in a full-length paper. You can find the preprint “Power Rules” here. Background There’s been some really good work lately on statistical power. I’ll point you to two really...