Karen Grace-Martin

When Can Count Data be Considered Continuous?

January 13th, 2012 by

Last month I did a webinar on Poisson and negative binomial models for count data. With a few hundred participants, we ran out of time to get through all the questions, so I’m answering some of them here on the blog.

This set of questions are all related to when it’s appropriate to treat count data as continuous and run the more familiar and simpler linear model.

Q: Do you have any guidelines or rules of thumb as far as how many discrete values an outcome variable can take on before it makes more sense to just treat it as continuous?

The issue usually isn’t a matter of how many values there are.  (more…)


The Difference Between Eta Squared and Partial Eta Squared

December 16th, 2011 by

It seems every editor and her brother these days wants to see standardized effect size statistics reported in journal articles.

For ANOVAs, two of the most popular are Eta-squared and partial Eta-squared.  In one way ANOVAs, they come out the same, but in more complicated models, their values, and their meanings differ.

SPSS only reports partial Eta-squared, and in earlier versions of the software it was (unfortunately) labeled Eta-squared.  More recent versions have fixed the label, but still don’t offer Eta-squared as an option.

Luckily Eta-squared is very simple to calculate yourself based on the sums of squares in your ANOVA table. I’ve written another blog post with all the formulas. You can (more…)


Should You Always Center a Predictor on the Mean?

December 2nd, 2011 by

Centering predictor variables is one of those simple but extremely useful practices that is easily overlooked.

It’s almost too simple.

Centering simply means subtracting a constant from every value of a variable.  What it does is redefine the 0 point for that predictor to be whatever value you subtracted.  It shifts the scale over, but retains the units.

The effect is that the slope between that predictor and the response variable doesn’t (more…)


Interpreting Interactions Between Two Effect-Coded Categorical Predictors

October 21st, 2011 by

I recently received this great question:

Question:

Hi Karen,  ive purchased a lot of your material and read a lot of your pdf documents w.r.t. regression and interaction terms.  Its, now, my general understanding that interaction for two or more categorical variables is best done with effects coding, and interactions  cont v. categorical variables is usually handled via dummy coding.  Further, i may mess this up a little but hopefully you’ll get my point and more importantly my question, i understand that

1)  given a fitted line Y = b0 + b1 x1 + b2 x2 + b3 x1*x2, the interpretation for b3 is the diff of the effect of x1 on Y, when x2 changes one unit, if x1 and x2 are cont.  ( also interpretation can be reversed in terms of x1 and x2). (more…)


The Repeated and Random Statements in Mixed Models for Repeated Measures

September 30th, 2011 by

“Because mixed models are more complex and more flexible than the general linear model, the potential for confusion and errors is higher.”

– Hamer & Simpson (2005)

Linear Mixed Models, as implemented in SAS’s Proc Mixed, SPSS Mixed, R’s LMER, and Stata’s xtmixed, are an extension of the general linear model.  They use more sophisticated techniques for estimation of parameters (means, variances, regression coefficients, and standard errors), and as the quotation says, are much more flexible.

Here’s one example of the flexibility of mixed models, and its resulting potential for confusion and error. (more…)


How Simple Should a Model Be? The Case of Insignificant Controls, Interactions, and Covariance Structures

September 23rd, 2011 by

Everything should be made as simple as possible, but no simpler” – Albert Einstein*Stage 2

For some reason, I’ve heard this quotation 3 times in the past 3 days.  Maybe I hear it everyday, but only noticed because I’ve been working with a few clients on model selection, and deciding how much to simplify a model.

And when the quotation fits, use it. (That’s the saying, right?)

*For the record, a quick web search indicated this may be a paraphrase, but it still applies.

The quotation is the general goal of model selection.  You really do want the model to be as simple as possible, but still able to answer the research question of interest.

This applies to many areas of model selection.  Here are a few examples: (more…)