TOC  
Task Oriented Communication
Bielefeld University

Faculty of Linguistics
and Literature


Faculty of Technology


  Back to Publications


A Multi-Modal Object Attention System for a Mobile Robot

A. Haasch, N. Hofemann, J. Fritsch and G. Sagerer

Abstract

Robot companions are intended for operation in private homes with naive users. For this purpose, they need to be endowed with natural interaction capabilities. Additionally, such robots will need to be taught unknown objects that are present in private homes. We present a multi-modal object attention system that is able to identify objects referenced by the user with gestures and verbal instructions. The proposed system can detect known and unknown objects and stores newly acquired object information in a scene model for later retrieval. This way, the growing knowledge base of the robot companion improves the interaction quality as the robot can more easily focus its attention on objects it has been taught previously.



toc  Homepage
Last Change: 2005-05-23
gk256www@techfak.uni-bielefeld.de