GeKiPe, a gesture-based interface for audiovisual performance

• José Miguel Fernandez, Institut de Recherche et Coordination Acoustique/Musique de Paris
• Thomas Köppel, Haute Ecole d'Art et de Design de Genève
• Nina Verstraete, Flashback Ensemble - Conservatoire à Rayonnement Régional (CRR) de Musique, de Danse et d'Art dramatique Perpignan Méditerranée
• Grégoire Lorieux, Institut de Recherche et Coordination Acoustique/Musique de Paris
• Alexander Vert, Flashback Ensemble - Conservatoire à Rayonnement Régional (CRR) de Musique, de Danse et d'Art dramatique Perpignan Méditerranée
• Philippe Spiesser, Haute Ecole de Musique de Genève

Abstract

We present here GeKiPe, a gestural interface for musical expression, combining images and sounds, generated and controlled in real time by a performer. GeKiPe is developed as part of a creation project, exploring the control of virtual instruments through the analysis of gestures specific to instrumentalists, and to percussionists in particular. GeKiPe was used for the creation of a collaborative stage performance (Sculpt), in which the musician and their movements are captured by different methods (infrared Kinect cameras and gesture-sensors on controller gloves). The use of GeKiPe as an alternate sound and image controller allowed us to combine body movement, musical gestures and audiovisual expressions to create challenging collaborative performances.

Files

• The Paper: GeKiPe, a gesture-based interface for audiovisual performance
• Item 1: Item 1.txt
• Item 2: Item 2.pdf

Back to Table of Contents