claPPP
media installation by
Christian Graupner, Humatic
in collaboration with Department of Signal Processing and Acoustics, Aalto University, Finland &
João Pais, co-composer and system developer
format :
cluster generating & audience reactive system
3 screens or subscreens HD video , min 3 audio channels, acoustical & optical sensors to detect audience activities, computers & software.
production year 2012
first preview : TBA
premiere TBA
Updates & documentation :
http://clappp.humatic.net
Current State : concept & tests
Working Title: claPPP brief description ( version by Cumhur Erkut, Academy research fellow,)
While investigating the expressive but natural interfaces in human-computer interaction and interactive music, clapping - one of the oldest and most natural form of human expression of appreciation and musical participation - and other expressive non-speech sounds remain strangely underused. Since these sounds are typically supported by continuous whole-body movements, multi-modal processing of audio-vision, with microphone arrays and gesture-tracking cameras have the potential to provide better recognition accuracy compared to each modality alone.
We propose to explore this potential with a multichannel audio-visual installation that can react to such audience expressions, and (tentatively) call it claPPP. Based on H.RP [Humatic Re Performing] conceptual platform a media triptych will show a multifaceted hand clap performance that can generate endless poly-rhythmical clusters. Besides watching and listening these clusters visitors can control and manipulate the flow by their own claps. The concerted performance, the cluster generation which preserves the original character of the material during comprehensible interactive audience access open new spaces for associations to the clap sequences.
The 'magical' media-presentation methods will demonstrate the next level of H.RP technology which allows an abrupt-free playback of nonlinear movies. The sonic gestures of the audience will be detected by microphones and contact-free sensor devices, and provide the control. The main technical and logistical challenges are the balance and separation user- and machine events referred to both input detection and media playback.
H.RP [Humatic Re Performing]
pdf
Partners in creation
Dr. Sci (Tech.) Cumhur Erkut, Academy research fellow, Department of Signal Processing and Acoustics, Aalto University School of Electrical Engineering:
Antti Jylhä ( system developer ) . Department of Signal Processing and Acoustics, Aalto University
João Pais, co-composer and system developer
Christian Graupner (GER) Humatic, concept & video, co-composer
The Berlin-based artist is exploring in his latest work the practices and myths around pop and contemporary music and combines multi channel video &sound with partly machine- partly user-controlled 'humatic' interfaces and mechanisms. His recent sculptural / media work includes gambling machines and asian mojo figures, feedback guitars and beatbox-like vocal- & dance performances. In processing visual and audio material, he not only uses and adapts available computer programs but also uses the developments coded by his project collaborators.
CG's wide ranging earlier works were made up of drawings, paintings and experimental electronic music, mostly published on records, CDs as well as in movies and radio plays under the pseudonym VOOV (Violation of Ordinary Values). With his works such as '2Lives Left' and newest projects 'MindBox' and 'Don't Dance', he is keeping alive his conceptual platform 'Automatic Clubbing'. In 2000 he formed the independent artist group and production company Humatic Ltd. together with Nils Peters who develops software tools for artists working in a variety of media forms. CG has been guest at ZKM Karlsruhe . His work has been shown and performed worldwide
CV: http://www.humatic.de/cv/cg.html