Time to Overcome the Neglect of Effect Sizes in Teaching Psychological Research Findings

Honekopp, Johannes and Greer, Jo (2019) Time to Overcome the Neglect of Effect Sizes in Teaching Psychological Research Findings. Scholarship of Teaching and Learning in Psychology, 5 (2). pp. 128-139. ISSN 2332-2101

[img] Text
NRL Honekopp Greer.docx - Accepted Version

Download (208kB)
[img]
Preview
Text
NRL_Honekopp_Greer.pdf

Download (259kB) | Preview
Official URL: https://doi.org/10.1037/stl0000142

Abstract

Due to reliance on null-hypothesis significance testing, researchers had widely neglected effect size (ES) in their reporting of psychological research results. The American Psychological Association and others identified this as a problem and initiated reform, and ES reporting is now common in the scholarly literature. To what extent problematic ES neglect occurs in the teaching of psychological research findings remains unknown. In order to address this question, we analysed the content of 10 bestselling psychology textbooks from five popular sub-fields (Study 1). Overall, 76% (95% CI [69%, 79%]) of portrayals of empirical findings were devoid of useful ES information and merely mentioned the direction of the effect discussed. Such a direction-only description of any research finding would appear particularly uninformative if laypeople’s intuitions about the direction of this effect were already accurate. Study 2 therefore tested how well 286 non-psychology undergraduate students could guess the direction (or absence) of a representative sample of effects. Irrespective of psychological sub-field of the effects, average accuracy was only 47% [42%, 51%], demonstrating participants’ poor intuitions regarding these effects. This suggests that the predominant direction-only description of research findings in textbooks is not without merits. However, we argue that greater consideration of ES in the teaching of psychological research findings is desirable. We suggest three simple and efficient strategies to this end and weight their relative merits.

Item Type: Article
Uncontrolled Keywords: effect size, critical thinking, statistical reform, teaching, psychology
Subjects: C800 Psychology
Department: Faculties > Health and Life Sciences > Psychology
Depositing User: Elena Carlaw
Date Deposited: 27 Feb 2019 11:47
Last Modified: 01 Aug 2021 11:21
URI: http://nrl.northumbria.ac.uk/id/eprint/38218

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics