A study on mobile robot control by hand gesture detection

Abstract

Recently, method of controlling machine with natural control called Natural User Interface has attracted attention. particularly, human hand is considered to be communication media that can communicate information most naturally. In this paper, user hand is detected by following acquired skin color of the user's face, through face detection. After detecting the user hand, hand gesture is determined. Finally, a robot is controlled to have multi movements according to detected several hand gesture patterns. We succeeded in acquiring the skin color information from user's face and detecting both user’s hand and hand gesture following that. In this paper, we developed a mobile robot to conduct experiments. We also confirmed that robot can be controlled by human hand gesture.