Use of human gestures for controlling a mobile robot via adaptive CMAC network and fuzzy logic controller

Zhou, Dajun, Shi, Minghui, Chao, Fei, Lin, Chih-Min, Yang, Longzhi, Shang, Changjing and Zhou, Changle (2018) Use of human gestures for controlling a mobile robot via adaptive CMAC network and fuzzy logic controller. Neurocomputing, 282. pp. 218-231. ISSN 0925-2312

Zhou et al - Use of Human Gestures for Controlling a Mobile Robot.pdf - Accepted Version
Available under License Creative Commons Attribution Non-commercial No Derivatives 4.0.

Download (3MB) | Preview
Official URL:


Mobile robots with manipulators have been more and more commonly applied in extreme and hostile environments to assist or even replace human operators for complex tasks. In addition to autonomous abilities, mobile robots need to facilitate the human–robot interaction control mode that enables human users to easily control or collaborate with robots. This paper proposes a system which uses human gestures to control an autonomous mobile robot integrating a manipulator and a video surveillance platform. A human user can control the mobile robot just as one drives an actual vehicle in the vehicle’s driving cab. The proposed system obtains human’s skeleton joints information using a motion sensing input device, which is then recognized and interpreted into a set of control commands. This is implemented, based on the availability of training data set and requirement of in-time performance, by an adaptive cerebellar model articulation controller neural network, a finite state machine, a fuzzy controller and purposely designed gesture recognition and control command generation systems. These algorithms work together implement the steering and velocity control of the mobile robot in real-time. The experimental results demonstrate that the proposed approach is able to conveniently control a mobile robot using virtual driving method, with smooth manoeuvring trajectories in various speeds.

Item Type: Article
Uncontrolled Keywords: Mobile robot; Mobile manipulator; Intelligent control; Human–robot interactions
Subjects: G400 Computer Science
Department: Faculties > Engineering and Environment > Computer and Information Sciences
Depositing User: Paul Burns
Date Deposited: 23 Feb 2018 12:27
Last Modified: 31 Jul 2021 13:46

Actions (login required)

View Item View Item


Downloads per month over past year

View more statistics