Resolving Occlusion for 3D Object Manipulation with Hands in Mixed Reality

Feng, Qi, Shum, Hubert and Morishima, Shigeo (2018) Resolving Occlusion for 3D Object Manipulation with Hands in Mixed Reality. In: VRST 2018 - 24th ACM Symposium on Virtual Reality Software and Technology, 28th November - 1st December 2018, Tokyo, Japan.

Full text not available from this repository.

Abstract

Due to the need to interact with virtual objects, the hand-object interaction has become an important element in mixed reality (MR) applications. In this paper, we propose a novel approach to handle the occlusion of augmented 3D object manipulation with hands by exploiting the nature of hand poses combined with tracking-based and model-based methods, to achieve a complete mixed reality experience without necessities of heavy computations, complex manual segmentation processes or wearing special gloves. The experimental results show a frame rate faster than real-time and a great accuracy of rendered virtual appearances, and a user study verifies a more immersive experience compared to past approaches. We believe that the proposed method can improve a wide range of mixed reality applications that involve hand-object interactions.

Item Type:	Conference or Workshop Item (Other)
Subjects:	G400 Computer Science
Department:	Faculties > Engineering and Environment > Computer and Information Sciences
Related URLs:	Organisation
Depositing User:	Paul Burns
Date Deposited:	15 Nov 2018 12:05
Last Modified:	11 Oct 2019 14:51
URI:	http://nrl.northumbria.ac.uk/id/eprint/36708

Downloads