Ivy League Research
Are we more likely to believe research from high-status universities?
Overview
Research from academic universities can expand our knowledge and aide societal progress. But good research often requires resources and talent. Does that mean the best research comes from the best universities? Not exactly. Both Ivy League and lesser-known schools have published ground-breaking research. Both have also published mediocre and even downright shoddy research.
Nevertheless, given the selectivity of high-status universities, it’s possible that the public views their research as more believable regardless of its actual quality.
The Experiment
To test whether research from a higher-status university is viewed as more credible than other schools, we conducted an experiment with 400 people on Amazon Mechanical Turk. Participants were provided a summary of a research study and told that it was either from Harvard University or a lesser-known school, Salem State University (randomly assigned). Participants were told the following:
Research from academic universities can expand our knowledge and aide societal progress. But good research often requires resources and talent. Does that mean the best research comes from the best universities? Not exactly. Both Ivy League and lesser-known schools have published ground-breaking research. Both have also published mediocre and even downright shoddy research.
Nevertheless, given the selectivity of high-status universities, it’s possible that the public views their research as more believable regardless of its actual quality.
The Experiment
To test whether research from a higher-status university is viewed as more credible than other schools, we conducted an experiment with 400 people on Amazon Mechanical Turk. Participants were provided a summary of a research study and told that it was either from Harvard University or a lesser-known school, Salem State University (randomly assigned). Participants were told the following:
The following claim may or may not be true:
A research study from [Harvard University / Salem State University] suggests that internet search engines reduce our ability to remember information.
A research study from [Harvard University / Salem State University] suggests that internet search engines reduce our ability to remember information.
Participants were then asked, "How strongly do you believe this research finding is true?" and responded by answering on a 1-7 scale (1 = Not at all, 7 = Very much).
Results
There was practically no difference in research believability between the Harvard University framing (avg. = 4.62) and the Salem State University framing (avg. = 4.58) (p = 0.813). Our 95% confidence interval of -0.28 to 0.36 indicates that even if these results were just due to chance sampling, any difference would likely be trivial.
Results
There was practically no difference in research believability between the Harvard University framing (avg. = 4.62) and the Salem State University framing (avg. = 4.58) (p = 0.813). Our 95% confidence interval of -0.28 to 0.36 indicates that even if these results were just due to chance sampling, any difference would likely be trivial.
Thus, it seems that everyday people don’t give a credibility bump to ivy league research. Of course, this leaves open the question of whether actual research credibility differs between certain types of schools. With a growing dataset of research study replications, it’s a question we plan to investigate.
Methods Note:
We used ordinary least squares (OLS) regression analysis to test for significant differences in believability between the Harvard and Salem State research conditions, For significant differences, the coefficient would be large and its corresponding “p-value” would be small. If the p-value is less than 0.05, we consider the difference statistically significant.
Popular Experiments
COVID MasksDoes wearing a COVID mask affect how others think of you?
|
Video GamesAre video games more enjoyable than board games?
Does age or gender matter? |
Zero-Sum PoliticsDo Democrats or Republicans view society as win-lose?
|