Malleable Device for interactive Sonification

A MALLEABLE DEVICE WITH APPLICATIONS TO SONIFICATION-BASED DATA EXPLORATION

Authors: Matthias Milczynsik, Thomas Hermann, Till Bovermann, Helge Ritter
Int. Conf. on Auditory Display (ICAD 2006), submitted

Abstract
This article introduces a novel human computer interaction device, developed in the scope of a Master’s Thesis [1]. The device allows continuous localized interaction by providing a malleable interaction surface. Diverse multi-finger as well as multi-handed manipulations can be applied. Furthermore, the device acts as a tangible user interface object, integrated into a tangible computing framework called tDesk [2]. Software to convert the malleable element’s shape into an internal surface representation has been developed. Malleable interactions are applied to a new Model-based Sonification approach for exploratory data analysis. High-dimensional data are acoustically explored via their informative interaction sound in result to excitation.

Download: MilczynskiHermannBovermannRitter2006-AMD.pdf (available soon)

Sonification Examples

Example S1 Exploration 1 Region 1 S1 (mp3, 700k)
Example S2 Exploration 1 Region 2 S2 (mp3, 724k)
Example S3 Exploration 2 Region 1 S3 (mp3, 82k)
Example S4 Exploration 2 Region 2 S4 (mp3, 108k)
Example S5 Exploration 2 Region 3 S5 (mp3, 236k)

modified 2006-02-07, contact: Thomas Hermann Matthias Milczynski