- Thomas Hermann, Stella Paschalidou, Dirk Beckmann,
Helge Ritter (2006)
In Gibet, Sylvie and Courty, Nicolas and Kamp, Jean-Francois (Ed.) Gesture in Human-Computer Interaction and Simulation: 6th International Gesture Workshop, GW 2005, Berder Island, France, May 18-20, 2005, Revised Selected Papers, p. 335--338, Springer, Berlin, Heidelberg
[BibTeX Entry]
Summary
This paper presents an interactive multi-modal system for real-time multi-parametric gestural control of audio processing applications. We claim that this can ease the use / control of different tasks and for this we present the following as a demonstration: (1) A musical application, i.e. the multi-parametric control of digital audio effects, and (2) a scientific application, i.e. the interactive navigation of audifications. In the first application we discuss the use of PCA-based control axes and clustering to obtain dimensionality reduced control variables. In the second application we show how the tightly closed human-computer loop actively supports the detection and discovery of features in data under analysis.
Contact
Thomas Hermann
Gestural Interactions for Multi-parameter Audio Control and Audification
Interactive Audification Examples
Interactive Filter Optimization:
download as .mp4! (5.5 MB)
download as .avi! (5.7 MB)
download uncompressed avi (14MB)
Interactive Audification of Seismic Data:
download as .mp4! (6.4 MB)
download as .avi! (7.4 MB)
download uncompressed avi (18MB)