Simulating interactions of avatars in high dimensional state space

Shum, Hubert P. H., Komura, Taku and Yamazaki, Shuntaro (2008) Simulating interactions of avatars in high dimensional state space. In: I3D '08: Proceedings of the 2008 symposium on Interactive 3D graphics and games, 15-17 February 2008, Redwood City, CA, USA.

Preview	Video (AVI) (Animation describing research (Part 1)) Shum_1sim_interaction_of_avatars.avi - Supplemental Material Download (35MB) | Preview
Preview	Video (AVI) (Animation describing research (Part 2)) Shum_2_sim_interaction_of_avatars.avi - Supplemental Material Download (14MB) | Preview

Abstract

Efficient computation of strategic movements is essential to control virtual avatars intelligently in computer games and 3D virtual environments. Such a module is needed to control non-player characters (NPCs) to fight, play team sports or move through a mass crowd. Reinforcement learning is an approach to achieve real-time optimal control. However, the huge state space of human interactions makes it difficult to apply existing learning methods to control avatars when they have dense interactions with other characters. In this research, we propose a new methodology to efficiently plan the movements of an avatar interacting with another. We make use of the fact that the subspace of meaningful interactions is much smaller than the whole state space of two avatars. We efficiently collect samples by exploring the subspace where dense interactions between the avatars occur and favor samples that have high connectivity with the other samples. Using the collected samples, a finite state machine (FSM) called Interaction Graph is composed. At run-time, we compute the optimal action of each avatar by minmax search or dynamic programming on the Interaction Graph. The methodology is applicable to control NPCs in fighting and ball-sports games.

Actions (login required)

View Item

Downloads