Baseline Probabilities for Two-Alternative Forced Choice Tasks When Judging Stimuli in Evolutionary Psychology: A Methodological Note

Pollet, Thomas and Little, Anthony (2017) Baseline Probabilities for Two-Alternative Forced Choice Tasks When Judging Stimuli in Evolutionary Psychology: A Methodological Note. Human Ethology Bulletin, 32 (1). pp. 53-59. ISSN 2224-4476

[img]
Preview
Text
HEB_2017_32_1_53-59-1.pdf - Published Version
Available under License Creative Commons Attribution 4.0.

Download (914kB) | Preview
Official URL: https://doi.org/10.22330/heb/321/053-059

Abstract

Many paradigms in evolutionary psychology involve forced choice tasks with two alternatives. While the number of trials used across studies varies substantially, in such tasks it is common to test against a baseline of 50% (often via a one-sample t-test). In this paper, we simulate forced choice designs, varying in sample sizes (30 to 120) and number of trials (2 to 34) to empirically examine the usefulness of a 50% benchmark. Our results show that 50% is a weak benchmark when using a small number of trials. The simulations also indicate that increasing the number of trials is beneficial if one wants to use a 50% benchmark. There are however, marginal returns to increasing the number of trials: moving from 2 to 8 trials matters substantially more than moving from 28 to 34. Our approach also illustrates the value of simulations for understanding experimental designs, such as forced choice tasks, in evolutionary psychology.

Item Type: Article
Uncontrolled Keywords: Simulations, methodology, probability, base rate
Subjects: C800 Psychology
Department: Faculties > Health and Life Sciences > Psychology
Depositing User: Becky Skoyles
Date Deposited: 21 Sep 2017 10:40
Last Modified: 25 Oct 2017 20:07
URI: http://nrl.northumbria.ac.uk/id/eprint/31921

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics


Policies: NRL Policies | NRL University Deposit Policy | NRL Deposit Licence