by Ursula Saqui, Ph.D.
This is the second post of a two-part series on the overall process of doing a literature review. Part one discussed the benefits of doing a literature review, how to get started, and knowing when to stop.
You have made a commitment to do a literature review, have the purpose defined, and are ready to get started.
Where do you find your resources?
If you are not in academia, have access to a top-notch library, or receive the industry publications of interest, you may need to get creative if you do not want to pay for each article. (In a pinch, I have paid up to $36 for an article, which can add up if you are conducting a comprehensive literature review!)
Here is where the internet and other community resources can be your best friends.
- Know the difference between Google and Google Scholar. Google is helpful for popular mainstream publications whereas Google Scholar focuses only on scholarly references such as articles, theses, books, abstracts, and court opinions that are written by academics and other professional scholars.
- ResearchGATE is an example of a collaborative scientific community that indexes articles. Many times you can find the full text of articles at no charge.
- Your state may offer access to different databases for its residents. For example, in my home state of Indiana, residents have access to Inspire, a collection of resources, databases, and government publications. Click here to see if your state offers a similar resource.
- Check your local community library. They may not have the resources you need but they can often get them through inter-library loan. For example, my local community library does not carry advanced statistics books but the librarians can get them for me via their borrowing privileges with universities.
- Even without access to a specific database, you can search thousands of government sponsored research reports that have been conducted by the U.S. government or one of its affiliates. For example, in completing a literature review of service learning programs, I found a government report that summarized 10 years of research in service learning. (That made my day!)
- Private foundations or research companies may also conduct high-quality peer-reviewed research. For example, the Robert Wood Johnson Foundation conducts and disseminates research on issues related to health and health care.
- If you know who authored the article, you can sometimes find a pdf file of their article on their website or university website listed under their vita or recent publications.
- Try to contact the author directly. When I have contacted authors, they have graciously sent me a complimentary copy of their article.
Still stuck? Hire someone who knows how to do a good literature review and has access to quality resources.
On a budget? Hire a student who has access to an academic library. Many times students can get credit for working on research and business projects through internships or experiential learning programs. This situation is a win-win. You get the information you need and the student gets academic credit along with exposure to new ideas and topics.
About the Author: With expertise in human behavior and research, Ursula Saqui, Ph.D. gives clarity and direction to her clients’ projects, which inevitably lead to better results and strategies. She is the founder of Saqui Research.
by Ursula Saqui, Ph.D.
This post is the first of a two-part series on the overall process of doing a literature review. Part two covers where to find your resources.
Would you build your house without a foundation? Of course not! However, many people skip the first step of any empirical-based project–conducting a literature review. Like the foundation of your house, the literature review is the foundation of your project.
Having a strong literature review gives structure to your research method and informs your statistical analysis. If your literature review is weak or non-existent, (more…)
One of the most anxiety-laden questions I get from researchers is whether their analysis is “right.”
I’m always slightly uncomfortable with that word. Often there is no one right analysis.
It’s like finding Mr. or Ms. Right. Most of the time, there is not just one Right. But there are many that are clearly Wrong.
What Makes an Analysis Right?
Luckily, what makes an analysis right is easier to define than what makes a person right for you. It pretty much comes down to two things: whether the assumptions of the statistical method are being met and whether the analysis answers the research question.
Assumptions are very important. A test needs to reflect the measurement scale of the variables, the study design, and issues in the data. A repeated measures study design requires a repeated measures analysis. A binary dependent variable requires a categorical analysis method.
But within those general categories, there are often many analyses that meet assumptions. A logistic regression or a chi-square test both handle a binary dependent variable with a single categorical predictor. But a logistic regression can answer more research questions. It can incorporate covariates, directly test interactions, and calculate predicted probabilities. A chi-square test can do none of these.
So you get different information from different tests. They answer different research questions.
An analysis that is correct from an assumptions point of view is useless if it doesn’t answer the research question. A data set can spawn an endless number of statistical tests that don’t answer the research question. And you can spend an endless number of days running them.
When to Think about the Analysis
The real bummer is it’s not always clear that the analyses aren’t relevant until you write up the research paper.
That’s why writing out the research questions in theoretical and operational terms is the first step of any statistical analysis. It’s absolutely fundamental. And I mean writing them in minute detail. Issues of mediation, interaction, subsetting, control variables, et cetera, should all be blatantly obvious in the research questions.
Thinking about how to analyze the data before collecting the data can help you from hitting a dead end. It can be very obvious, once you think through the details, that the analysis available to you based on the data won’t answer the research question.
Whether the answer is what you expected or not is a different issue.
So when you are concerned about getting an analysis “right,” clearly define the design, variables, and data issues, but most importantly, get explicitly clear about what you want to learn from this analysis.
Once you’ve done this, it’s much easier to find the statistical method that answers the research questions and meets assumptions. Even if you don’t know the right method, you can narrow your search with clear guidance.
My 8 year-old son got a Rubik’s cube in his Christmas stocking this year.
I had gotten one as a birthday present when I was about 10. It was at the height of the craze and I was so excited.
I distinctly remember bursting into tears when I discovered that my little sister sneaked playing with it, and messed it up the day I got it. I knew I would mess it up to an unsolvable point soon myself, but I was still relishing the fun of creating patterns in the 9 squares, then getting it back to 6 sides of single-colored perfection. (I loved patterns even then). (more…)
Spending the summer writing a research grant proposal? Stuck on how to write up the statistics section?
An excellent handbook that outlines how to prepare the statistical content for grant proposals is “Statistics Guide for Research Grant Applicants.” Sections include “Describing the Study Design”, “Sample Size Calculations”, and “Describing the Statistical Methods,” among others.
The navigation for the guide is not obvious–it is in the left margin menu, among other menus, toward the bottom. You have to scroll down from the top of the page to see it.
The authors, JM Bland, BK Butland, JL Peacock, J Poloniecki, F Reid, P Sedgwick, are statisticians at St. George’s Hospital Medical School, London.
The steps you take to analyze data are just as important as the statistics you use. Mistakes and frustration in statistical analysis come as much, if not more, from poor process than from using the wrong statistical method.
Benjamin Earnhart of the University of Iowa has written a short (and humorous) article entitled “Respect Your Data” (requires LinkedIn account) that describes 23 practical steps that data analysts must take. This article was published in the newsletter of the American Statistical Association and has since been expanded and annotated
