Modality Integration and Dialog Management for a Robotic Assistant

Bielefeld University

Faculty of Linguistics
and Literature

Faculty of Technology

Modality Integration and Dialog Management for a Robotic Assistant

I. Toptsis, A. Haasch, S. Hüwel, J. Fritsch and G.A. Fink

Abstract

The communication with robotic assistants or companions is a challenging new domain for the use of dialog systems. In contrast to classical spoken language interfaces users interact with mobile robots mostly in a multi-modal way. In this paper we will present the integration of several modalities in the dialog system of BIRON - the Bielefeld Robot Companion. Besides speech as the main modality the system integrates deictic gestures and visual scene information in order to resolve object references in a task oriented dialog. We will present example interactions with BIRON and first qualitative results from the "home-tour" scenario defined within the COGNIRON project.

Homepage

Last Change: 2005-08-26
gk256www@techfak.uni-bielefeld.de