Record Details

A real-time framework for vision based human robot interaction

DSpace at IIT Bombay

View Archive Info
 
 
Field Value
 
Title A real-time framework for vision based human robot interaction
 
Creator SINGH, RANDEEP
SETH, BHARTENDU
DESAI, UB
 
Subject gesture recognition
image colour analysis
image motion analysis
man-machine systems
mobile robots
 
Description Interactive mobile robots are an active area of research. This paper presents a framework for designing a real-time vision based hand-body dynamic gesture recognition system for such robots. The said framework works in real world lighting conditions with complex backgrounds, and can handle intermittent motion of the camera. We present here a novel way in which the motion history image (MHI) and the motion energy image (MEI) is built. We propose a robust combining of the motion and color cues and we call this image as motion color image (MCI). The input signal is captured by using monocular color camera. Vision is the only feedback sensor being used. It is assumed that the gesturer is wearing clothes that are slightly different from the background. Gestures are first learned offline and then matched to the temporal data generated online in real time. We have tested this on a gesture database consisting of 11 hand-body gestures and have recorded recognition accuracy up to 90%. We have partially implemented and testing the system for Sony's Aibo robot dog using remote framework (RFW) SDK by Sony.
 
Publisher IEEE
 
Date 2008-12-19T10:50:06Z
2011-11-27T20:01:16Z
2011-12-15T09:56:25Z
2008-12-19T10:50:06Z
2011-11-27T20:01:16Z
2011-12-15T09:56:25Z
2006
 
Type Article
 
Identifier Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Beijing, China, 9-15 October 2006, 5831-5836
1-4244-0258-1
10.1109/IROS.2006.282397
http://hdl.handle.net/10054/407
http://dspace.library.iitb.ac.in/xmlui/handle/10054/407
 
Language en