In generalized linear models, there is a link function, which is the link between the mean of Y on the left and the fixed component on the right. In order to make the model fit in a linear form for these other distributions, we often need to take some function of the mean.

You think a linear regression might be an appropriate statistical analysis for your data, but you’re not entirely sure. What should you check before running your model to find out?

Creating a quality scale for a latent construct (a variable that cannot be directly measured with one variable) takes many steps. Structural Equation Modeling is set up well for this task. One important step in creating scales is making sure the scale measures the latent construct equally well and the same way for different groups […]

Mean imputation: So simple. And yet, so dangerous. Perhaps that’s a bit dramatic, but mean imputation (also called mean substitution) really ought to be a last resort. It’s a popular solution to missing data, despite its drawbacks. Mainly because it’s easy. It can be really painful to lose a large part of the sample you […]

Open data, particularly government open data is a rich source of information that can be helpful to researchers in almost every field, but what is open data? How do we find what we’re looking for? What are some of the challenges with using data directly from city, county, state, and federal government agencies?

There are many statistical concepts that are easy to confuse. Sometimes the problem is the terminology. We have a whole series of articles on Confusing Statistical Terms. But in these cases, it’s the concepts themselves. Similar, but distinct concepts that are easy to confuse. Some of these are quite high-level, and others are fundamental. For […]

When you’re model building, a key decision is which interaction terms to include. And which interactions to remove. As a general rule, the default in regression is to leave them out. Add interactions only with a solid reason. It would seem like data fishing to simply add in all possible interactions. And yet, that’s a […]

Statistical inference using hypothesis testing is ubiquitous in science. Several misconceptions and misinterpretations of p-values have arisen over the years, which can lead to challenges communicating the correct interpretation of results.

Most of the time when we plan a sample size for a data set, it’s based on obtaining reasonable statistical power for a key analysis of that data set. These power calculations figure out how big a sample you need so that a certain width of a confidence interval or p-value will coincide with a […]

Lest you believe that odds ratios are merely the domain of logistic regression, I’m here to tell you it’s not true. One of the simplest ways to calculate an odds ratio is from a cross tabulation table. We usually analyze these tables with a categorical statistical test. There are a few options, depending on the […]