Chan, Jacky C. P. and Ho, Edmond (2021) Emotion Transfer for 3D Hand and Full Body Motion using StarGAN. Computers, 10 (3). p. 38. ISSN 2073-431X
|
Text
computers-10-00038.pdf - Published Version Available under License Creative Commons Attribution 4.0. Download (21MB) | Preview |
|
|
Text
_Computers___Revision__Emotion_Transfer_for_3D_Hand_and_Full_Body__Motion_using_StarGAN.pdf - Accepted Version Available under License Creative Commons Attribution 4.0. Download (21MB) | Preview |
Abstract
In this paper, we propose a new data-driven framework for 3D hand and full-body motion emotion transfer. Specifically, we formulate the motion synthesis task as an image-to-image translation problem. By presenting a motion sequence as an image representation, the emotion can be transferred by our framework using StarGAN. To evaluate our proposed method's effectiveness, we first conducted a user study to validate the perceived emotion from the captured and synthesized hand motions. We further evaluate the synthesized hand and full body motions qualitatively and quantitatively. Experimental results show that our synthesized motions are comparable to the captured motions and those created by an existing method in terms of naturalness and visual quality.
| Item Type: | Article |
|---|---|
| Additional Information: | Funding information: We gratefully acknowledge the support of NVIDIA Corporation with the donation of the Titan Xp GPU used for this research. |
| Uncontrolled Keywords: | hand animation, body motion, skeletal motion, emotion, motion capture, generative adversarial network, style transfer, user study |
| Subjects: | G400 Computer Science |
| Department: | Faculties > Engineering and Environment > Computer and Information Sciences |
| Depositing User: | John Coen |
| Date Deposited: | 22 Mar 2021 15:46 |
| Last Modified: | 27 Aug 2021 13:34 |
| URI: | http://nrl.northumbria.ac.uk/id/eprint/45755 |
Actions (login required)
 |
View Item |
Downloads
Downloads per month over past year
