Emotion Transfer for 3D Hand and Full Body Motion using StarGAN

Chan, Jacky C. P. and Ho, Edmond (2021) Emotion Transfer for 3D Hand and Full Body Motion using StarGAN. Computers, 10 (3). p. 38. ISSN 2073-431X

[img]
Preview
Text
computers-10-00038.pdf - Published Version
Available under License Creative Commons Attribution 4.0.

Download (21MB) | Preview
[img]
Preview
Text
_Computers___Revision__Emotion_Transfer_for_3D_Hand_and_Full_Body__Motion_using_StarGAN.pdf - Accepted Version
Available under License Creative Commons Attribution 4.0.

Download (21MB) | Preview
Official URL: https://doi.org/10.3390/computers10030038

Abstract

In this paper, we propose a new data-driven framework for 3D hand and full-body motion emotion transfer. Specifically, we formulate the motion synthesis task as an image-to-image translation problem. By presenting a motion sequence as an image representation, the emotion can be transferred by our framework using StarGAN. To evaluate our proposed method's effectiveness, we first conducted a user study to validate the perceived emotion from the captured and synthesized hand motions. We further evaluate the synthesized hand and full body motions qualitatively and quantitatively. Experimental results show that our synthesized motions are comparable to the captured motions and those created by an existing method in terms of naturalness and visual quality.

Item Type: Article
Additional Information: Funding information: We gratefully acknowledge the support of NVIDIA Corporation with the donation of the Titan Xp GPU used for this research.
Uncontrolled Keywords: hand animation, body motion, skeletal motion, emotion, motion capture, generative adversarial network, style transfer, user study
Subjects: G400 Computer Science
Department: Faculties > Engineering and Environment > Computer and Information Sciences
Depositing User: John Coen
Date Deposited: 22 Mar 2021 15:46
Last Modified: 27 Aug 2021 13:34
URI: http://nrl.northumbria.ac.uk/id/eprint/45755

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics