Distinguishing between statistical significance and practical/clinical meaningfulness using statistical inference.

Wilkinson, Mick (2014) Distinguishing between statistical significance and practical/clinical meaningfulness using statistical inference. Sports Medicine, 44 (3). pp. 295-301. ISSN 0112-1642

[img] Microsoft Word (The final publication is available at Springer via http://dx.doi.org/10.1007/s40279-013-0125-y)
SPOA-D-13-00142_Sp_Med_main_document_-Accepted.doc - Accepted Version

Download (174kB)
[img]
Preview
PDF (The final publication is available at Springer via http://dx.doi.org/10.1007/s40279-013-0125-y)
SPOA-D-13-00142_Sp_Med_main_document_-Accepted_(1).pdf - Accepted Version

Download (227kB) | Preview
Official URL: http://dx.doi.org/10.1007/s40279-013-0125-y

Abstract

Decisions about support for predictions of theories in light of data are made using statistical inference. The dominant approach in sport and exercise science is the Neyman-Pearson significance-testing approach. When applied correctly it provides a reliable procedure for making dichotomous decisions for accepting or rejecting zero-effect null hypotheses with known and controlled long-run error rates. Type I and type II error rates must be specified in advance and the latter controlled by conducting an a priori sample size calculation. The Neyman-Pearson approach does not provide the probability of hypotheses or indicate the strength of support for hypotheses in light of data, yet many scientists believe it does. Outcomes of analyses allow conclusions only about the existence of non-zero effects, and provide no information about the likely size of true effects or their practical / clinical value. Bayesian inference can show how much support data provide for different hypotheses, and how personal convictions should be altered in light of data, but the approach is complicated by formulating probability distributions about prior-subjective estimates of population effects. A pragmatic solution is magnitude-based inference, which allows scientists to estimate the true magnitude of population effects and how likely they are to exceed an effect magnitude of practical / clinical importance thereby integrating elements of subjective-Bayesian-style thinking. While this approach is gaining acceptance, progress might be hastened if scientists appreciate the shortcomings of traditional N-P null-hypothesis-significance testing.

Item Type: Article
Uncontrolled Keywords: decision logic, bayesian analysis
Subjects: G300 Statistics
Department: Faculties > Health and Life Sciences > Sport, Exercise and Rehabilitation
Depositing User: Mick Wilkinson
Date Deposited: 13 Jul 2015 07:56
Last Modified: 30 Oct 2017 14:21
URI: http://nrl.northumbria.ac.uk/id/eprint/23317

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics


Policies: NRL Policies | NRL University Deposit Policy | NRL Deposit Licence