Instant 3D design concept generation and visualization by real-time hand gesture recognition

Kang, Jinsheng, Zhong, Kang, Qin, Sheng-feng, Wang, Hongan and Wright, David (2013) Instant 3D design concept generation and visualization by real-time hand gesture recognition. Computers in Industry, 64 (7). pp. 785-797. ISSN 01663615

Full text not available from this repository. (Request a copy)

Abstract

3D conceptual design is a creative process. While the designers are in the inspirational mode, they want to quickly express the design ideas in 3D and visualize it in real time without obstacle. In an exploration of a new, natural and more user friendly interface to assist rapid 3D conceptual generation and visualization, a prototype system of hand gesture and motion capture based user interface has been proposed and implemented. In this paper, we present the framework and components of this real time 3D conceptual generation and visualization system. Hand gestures were designed with the consideration of ease to use and the suitability for real time continuous recognition. Rule-based intelligent menu/icons were designed which changes the prompts according to the design process and expected operations. Real time hand gesture recognition was realized by skeleton model based template matching, and the use of hidden Markov models (HMMs). The recognized hand gestures become command script in OpenSCAD environment, and the 3D design concept was instantly generated and displayed on the screen. A case study was conducted for the initial evaluation of the system.

Item Type:	Article
Uncontrolled Keywords:	3D conceptual design, hand gesture, motion capture, computer aided design, concept generation and visualization
Subjects:	W200 Design studies
Department:	Faculties > Arts, Design and Social Sciences > Design
Depositing User:	Becky Skoyles
Date Deposited:	19 Mar 2014 12:31
Last Modified:	12 Oct 2019 19:36
URI:	http://nrl.northumbria.ac.uk/id/eprint/15859

Downloads