For nearly a hundred years the concept of “statistical significance” has been fundamental to statistics and to science. And for nearly that long, it has been controversial and misused as well. (more…)
statistical significance
Member Training: Moving to a World Beyond p<0.05
August 2nd, 2021 by TAF SupportMember Training: Inference and p-values and Statistical Significance, Oh My!
September 1st, 2020 by TAF Support
Statistical inference using hypothesis testing is ubiquitous in science. Several misconceptions and misinterpretations of p-values have arisen over the years, which can lead to challenges communicating the correct interpretation of results.
Should Confidence Intervals or Tests of Significance be Used?
December 20th, 2019 by Christos GiannoulisWhat is a Confidence Interval?
Any sample-based findings used to generalize a population are subject to sampling error. In other words, sample statistics won’t exactly match the population parameters they estimate.
Member Training: Writing Up Statistical Results: Basic Concepts and Best Practices
July 1st, 2019 by TAF SupportMany of us love performing statistical analyses but hate writing them up in the Results section of the manuscript. We struggle with big-picture issues (What should I include? In what order?) as well as minutia (Do tables have to be double-spaced?). (more…)
Your Questions Answered from the Interpreting Regression Coefficients Webinar
November 5th, 2018 by Karen Grace-MartinLast week I had the pleasure of teaching a webinar on Interpreting Regression Coefficients. We walked through the output of a somewhat tricky regression model—it included two dummy-coded categorical variables, a covariate, and a few interactions.
As always seems to happen, our audience asked an amazing number of great questions. (Seriously, I’ve had multiple guest instructors compliment me on our audience and their thoughtful questions.)
We had so many that although I spent about 40 minutes answering (more…)
Member Training: Adjustments for Multiple Testing: When and How to Handle Multiplicity
May 3rd, 2018 by guest contributer A research study rarely involves just one single statistical test. And multiple testing can result in more statistically significant findings just by chance.
After all, with the typical Type I error rate of 5% used in most tests, we are allowing ourselves to “get lucky” 1 in 20 times for each test. When you figure out the probability of Type I error across all the tests, that probability skyrockets.
(more…)