Occlusion for 3D Object Manipulation with Hands in Augmented Reality

Feng, Qi, Shum, Hubert and Morishima, Shigeo (2018) Occlusion for 3D Object Manipulation with Hands in Augmented Reality. In: MIRU 2018 - 21st Meeting on Image Recognition and Understanding, 5th - 8th August 2018, Sapporo, Japan.

Full text not available from this repository.


By dynamically enhancing the reality with a wide range of applications, augmented reality has been drawing growing attention during recent years. Due to the need to interact with virtual objects, hand-object interaction has become a critical element in these applications. By enhancing existing objects with virtual visual appearance, tactile feedback can be provided to the user as well. However, to deal with problems of augmenting real objects with virtual data, a correct visual representation is needed. This becomes even more critical when the interaction between virtual and real objects happens. Incorrect occlusion information can be fatal to an immersive augmented reality experience. In this paper, we propose an innovative approach to handle the occlusion of augmented
3D object manipulation with hands in real-time by exploiting the nature of hand pose combined with tracking-based and model-based methods for estimating occlusion, to achieve a complete augmented reality experience without the necessities of heavy computations, complex manual segmentation processes or wearing special gloves.

Item Type: Conference or Workshop Item (Other)
Subjects: G400 Computer Science
Department: Faculties > Engineering and Environment > Computer and Information Sciences
Depositing User: Paul Burns
Date Deposited: 15 Nov 2018 16:53
Last Modified: 11 Oct 2019 18:30
URI: http://nrl.northumbria.ac.uk/id/eprint/36724

Actions (login required)

View Item View Item


Downloads per month over past year

View more statistics