A Turing test for crowds

Webster, Jamie and Amos, Martyn (2020) A Turing test for crowds. Royal Society Open Science, 7 (7). p. 200307. ISSN 2054-5703

rsos.200307.pdf - Published Version
Available under License Creative Commons Attribution 4.0.

Download (1MB) | Preview
Official URL: https://doi.org/10.1098/rsos.200307


The accuracy and believability of crowd simulations underpins computational studies of human collective behaviour, with implications for urban design, policing, security and many other areas. Accuracy concerns the closeness of the fit between a simulation and observed data, and believability concerns the human perception of plausibility. In this paper, we address both issues via a so-called ‘Turing test’ for crowds, using movies generated from both accurate simulations and observations of real crowds. The fundamental question we ask is ‘Can human observers distinguish between real and simulated crowds?’ In two studies with student volunteers (n = 384 and n = 156), we find that non-specialist individuals are able to reliably distinguish between real and simulated crowds when they are presented side-by-side, but they are unable to accurately classify them. Classification performance improves slightly when crowds are presented individually, but not enough to out-perform random guessing. We find that untrained individuals have an idealized view of human crowd behaviour which is inconsistent with observations of real crowds. Our results suggest a possible framework for establishing a minimal set of collective behaviours that should be integrated into the next generation of crowd simulation models.

Item Type: Article
Uncontrolled Keywords: crowd, simulation, Turing test
Subjects: G400 Computer Science
G500 Information Systems
Department: Faculties > Engineering and Environment > Computer and Information Sciences
Depositing User: Elena Carlaw
Date Deposited: 22 Jul 2020 15:38
Last Modified: 31 Jul 2021 12:00
URI: http://nrl.northumbria.ac.uk/id/eprint/43860

Actions (login required)

View Item View Item


Downloads per month over past year

View more statistics