eDrama: Facilitating online role-play using an AI actor and emotionally expressive characters

Zhang, Li, Gillies, Marco, Dhaliwal, Kulwant, Gower, Amanda, Robertson, Dale and Crabtree, Barry (2009) eDrama: Facilitating online role-play using an AI actor and emotionally expressive characters. International Journal of Artificial Intelligence in Education, 19 (1). pp. 5-38. ISSN 1560-4292

[img]
Preview
PDF (Article)
990_Zhang09.pdf - Accepted Version
Available under License Creative Commons Attribution No Derivatives.

Download (3MB) | Preview
Official URL: http://ijaied.org/pub/990/

Abstract

This paper describes a multi-user role-playing environment, e-drama, which enables groups of people to converse online, in scenario driven virtual environments. The starting point of this research – edrama – is a 2D graphical environment in which users are represented by static cartoon figures. An application has been developed to enable integration of the existing edrama tool with several new components to support avatars with emotionally expressive behaviours, rendered in a 3D environment. The functionality includes the extraction of affect from open-ended improvisational text. The results of the affective analysis are then used to: (a) control an automated improvisational AI actor – EMMA (emotion, metaphor and affect) that operates a bit-part character in the improvisation; (b) drive the animations of avatars using the Demeanour framework in the user interface so that they react bodily in ways that are consistent with the affect that they are expressing. Finally, we describe user trials that demonstrate that the changes made improve the quality of social interaction and users’ sense of presence. Moreover, our system has the potential to evolve normal classroom education for young people with or without learning disabilities by providing 24/7 efficient personalised social skill, language and career training via role-play and offering automatic monitoring.

Item Type: Article
Uncontrolled Keywords: E-drama, affect detection, emotionally expressive behaviour and an educational improvisational
Subjects: G400 Computer Science
G600 Software Engineering
G700 Artificial Intelligence
Department: Faculties > Engineering and Environment > Computer and Information Sciences
Depositing User: Ellen Cole
Date Deposited: 08 Dec 2011 15:48
Last Modified: 17 Dec 2023 13:30
URI: https://nrl.northumbria.ac.uk/id/eprint/3863

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics