Auditory Augmentation


You've heard of augmented reality, the increasingly popular technology which presents additional information to you about your environment through the use of visual overlays on camera-equipped phones. But our realities are also full of sound, sound that can be digitally augmented to communicate information and create feelings. What kinds of information about our surroundings can be communicated to us by modifying the sounds made by common objects that we interact with? This is the question addressed in the practice of auditory augmentation.


(WetterReim) e.g. allows to experience how a place's common soundscape may be artificially augmented with information streams. By carefully altering the structure-borne sound of a keyboard, which here stands for an everyday computer interface, information on the current weather situation is overlaid to the environment’s existing soundscape. This auditory augmentation alters according to the readings of environmental sensors. The worker therefore gets a subliminally perceived hint about the current weather conditions outside his office.


Adding an auditory augmentation to structure-borne sounds means to insert a thin layer between people’s action and an object’s natural auditory re-action. This auditory augmentation is designed to be easily overlaid to existing sounds while it does not change prominent and, perception-wise, essential auditory features of the augmented objects. In a peripheral monitoring situation as it can be found e.g. at a desktop workplace, the data representation therefore tends to be below the user’s conscious perception. A characteristic change in the data stream, however, will likely claim the user’s attention. 


The exhibited setup shows the capabilities of auditory augmentaion at hand of characteristic values for several weather situations. The visitor can switch between these setups and experience the difference of the  keyboard's changing sonic characteristic.


SuperColliders implementation for Auditory Augmentation consists currently of the following classes:


(ReimData) A convenience class for holding data

(ReimFilter) Stores and handles filter presets