tightly closed auditory interaction loops
bar shadow

Interactive Sonification Workshop
(ISon 2016)

December 16th 2016
(with satellite event on 15th)
CITEC, Bielefeld University, Bielefeld, Germany

Latest News


The ISon 2016 will take place in Bielefeld, Germany, on December 16th 2016, with a satellite event on the 15th of December 2016. It is organized by the Cognitive Interaction Technology Cluster of Excellence (CITEC).

The ISon 2016 meeting is the 5th International workshop on Interactive Sonification, following the initial ISon 2004 in Bielefeld and the previous ISon 2007 in York, ISon 2010 in Stockholm and ISon 2013 in Erlangen. The meeting offers the chance to:

In this workshop we will pay special attention to Adaptivity and Scaffolding in Interactive sonification, i.e. how auditory feedback and interactive sonification provide a scaffolding for familiarizing with interaction and learning to interact, and how users adapt their activity patterns according to the feedback and their level of experience. For example, a sports movement sonification could initially focus the displayed information on the most basic pattern (e.g. active arm) and once the user progresses (i.e. feedback indicates that they understand and utilize this information), increasingly subtle further cues (e.g. knees) would be made more salient. This feeds into the important question, how we can evaluate the complex and temporally developing interrelationship between the human user and an interactive system that is coupled to the user by means of interactive sonification. To make a sustainable contribution, we strongly encourage a reproducible research approach in Interactive Sonification to:

High quality will be assured by a peer-reviewing process, and besides an online publication in the Bielefeld University PUB data base we plan to also publish a special journal issue, as following the past ISon workshops (see IEEE Multimedia Special Issue on Interactive Sonification 2005, Springer Journal on Multimodal User Interfaces 2012 and IEEE Multimedia 2015).

About ISon

Sonification and Auditory Displays are increasingly becoming an established technology for exploring data, monitoring complex processes, or assisting exploration and navigation of data spaces. Sonification addresses the auditory sense by transforming data into sound, allowing the human user to get valuable information from data by using their natural listening skills. The main differences of sound displays over visual displays are that sound can: Auditory displays typically evolve over time since sound is inherently a temporal phenomenon. Interaction thus becomes an integral part of the process in order to select, manipulate, excite or control the display, and this has implications for the interface between humans and computers. In recent years it has become clear that there is an important need for research to address the interaction with auditory displays more explicitly.

Organising Committee (ISon 2016)

Conference Chairs:: Paper Chair: Advisory Board:

Satellite Events

There are several satellite events in connection to this workshop:

For more details about these satellite events please read the workshop programme.


On the 15th of December 2016, we offer four tutorial sessions on a variety of subjects. In these tutorials, participants will not only be able to learn about the interactive systems but also put in your sonification skill and design your own mini projects.

1) BRIX2 – Sebastian Zehe (Bielefeld University)



BRIX2 is a compact, modular Physical Computing prototyping platform. It allows users to easily attach different sensors and actuators to their computer or build completely standalone applications that sense the physical world and react to it.

The BRIX2 kit consists of the base module as well as different extension modules which can be stacked onto the base module as easy as Lego®. With BRIX2, users are able to sense motion, orientation, temperature, humidity, light intensity and proximity. The system can generate real-time feedback and alerts in three different modalities: auditory, haptic and visual. Internal batteries allow for standalone applications and the BRIX2 RF interface enables users you to send data wirelessly from one module to another.

In the BRIX2 workshop, participants will be able to try out the kit and develop their own applications. We will focus especially on using BRIX2 and its sensors as a data source for interactive sonifications. Prior knowledge and experience with Arduino, Microcontrollers and Electronics is appreciated, but absolutely not required.


2) HoloR: Interactive Mixed Reality Room  - Carsten Schwede (Bielefeld University)  


HoloR - short for Holographic Room is a stereoscopic, multi-person, multi-viewer, spatial projected augmented reality system, which enables applications to fade between different parts of the mixed-reality spectrum. In the workshop, we will explore the use of the movement tracking system, holographic display and sptial audio to design interactive movement sonification and other possibilities. 


3) Interactive Sonification of Body Motion Qualities - Roberto Bresin (KTH), Emma Frid (KTH), Ludvig Elblaus (KTH), Maurizio Mancini (University of Genova), Stefano Piana (University of Genova)

Body McCap picture 

The focus of this hands-on workshop is on the interactive sonification of body motion qualities. We will provide data from motion capture recordings of dancers moving with different qualities (e.g. fluid, rigid) in three different formats, videos, data files, and real-time streaming via OSC.

Three are the main activities that you can choose to work with at the workshop 

  1. Make your own sonifications of motion data provided by using your own sonification tools
  2. Identify and discuss sounds (for example from for) which best represent the body motion qualities represented in the provided videos (e.g. fluid, rigid)
  3. Fine tune existing sound synthesis models (provided at the workshop), by real-time manipulation of their parameters

At the end of the workshop participants will play their sonification to participants at the workshop.

This workshop is supported by the EU-funded DANCE project 

4) Business Process Sonification - Tobias Hildebrandt (University of Vienna)


Business processes can take a variety of forms, e.g. for handling insurance claims, guiding and monitoring the steps that users take by browsing and ordering products on a webshop, or controlling the steps of an industrial production process. During runtime, for each performed process step a log entry is created. Depending on the domain and the nature of a process, hundreds of thousands or more of such entries can aggregate over the course of a day. With current means focused on machine learning and visualization it is sometimes difficult to analyze this data in order to detect patterns and trends, bottlenecks, anomalies, deviations and malfunctions or to derive other business-related information. We have developed a prototype that combines interactive sonification and visualization for the analysis of process event logs.

In this session, you assume the role of a webshop owner who wants to analyze his/her accumulated process data with our tool. In the course of the session you will learn the structure and peculiarities of business process data, and how to analyze it. We will further think about the design of novel sonification and interaction techniques for this domain, which might also serve as inspirations for sonifications of other data of similar structure.


Call for Papers

Interactive Sonification is the specialized research topic concerned with the use of sound to portray data, but where there is a person at the heart of an interactive control loop. This workshop encourages submissions for oral or poster presentations that deal with: We invite two forms of presentation: To ensure a high quality of the contributions, all papers will go through a double-blind review selection process.

Proceedings and Special Issue

The peer-reviewed publications will be published on and with DOI on Bielefeld University PUB server. Participants are invited to extend their accepted papers to submit to a special issue of an international journal.

Paper Submission

The paper submission process is as follows. First, authors submit a 1-page extended abstract that is reviewed by the organizing committee. Then, the organizing committee selects the most relevant abstracts and notifies authors of their eligibility for full paper submission. Please note that the eligibility for submission is not a guarantee that the paper will be published. Finally, to guarantee a high quality of the contributions, full papers go through a double-blinded review process.

The details about the submission process are as follows:

For each accepted paper, at least one author must register for the ISon 2016 conference prior to the author registration deadline (see important dates). Papers with no registered author on the author registration deadline will be removed from the workshop programme and will not appear in the proceedings.

Reviewing Process

The reviewing process of the full paper is double-blinded: authors and reviewers will be anonymous to each other. Therefore, when preparing your manuscript for submission, do not put actual authors names on the first page and avoid excessive or explicit references to your own work. To ensure a high quality of the contributions, the following criteria will be considered: After the reviewing process, accepted papers will be designated (by the Programme Committee) either as posters or as lectures. All accepted papers have the same status, assignment as poster or lecture is not indicative of the relevance or potential impact but on the type of content and way to better reach the intended audience.

Paper Templates

For the full paper submission, please submit your paper in PDF format according to one of the following templates:

Submission Page

The submission website is:


ISon 2016 will feature a keynote by Prof. Tobias Heed of Bielefeld University.


Space and the Senses: Transformation and Integration


Each of our sensory systems is uniquely built. As one consequence, space is coded in very different ways across vision, touch, and audition. Yet, in our everyday experience, we naturally experience touch, sound, and vision in one common 3D world. To achieve such consistency, the brain must transform between the senses's different spatial codes, and it has been a long-standing research aim to determine which spatial coordinate system is the brain's final coding form. I will present experimental results from the areas of multisensory integration and sensorimotor control that demonstrate that, contrary to the assumption of this traditional endeavor, the brain does not convert all input into a common spatial code, but instead entertains many spatial codes in parallel. Often, several such coding schemes are then relevant in a particular task, which can either greatly improve, but also potentially hinder performance. Therefore, spatial coding schemes of the different senses, and the brain's strategies to integrate them, place important constraints on sonification.


Tobias Heed joined Bielefeld University in September 2016 as Full Professor of Biopsychology & Cognitive Neuroscience. He studied Business Administration in Stuttgart, Germany, before studying Psychology in Marburg an der Lahn, Germany. He received his PhD in 2008 from the University of Hamburg for research in the area of spatial tactile processing. In his early Postdoc years, he spent some time with Pieter Medendorp at the Donders Insititute in Nijmegen, Netherlands, to investigate motor planning for different effector systems. In 2012, he started his own research group in Hamburg, the Reach & Touch Lab, funded by the German Research Foundation's Emmy Noether program. His group's research focus, the integration of tactile processing with motor planning, as well as its development, continues to be the key interest of his new lab in Bielefeld.

Important Dates


Remember that, for each paper, at least one author must be registered for the conference by November 20th23rd 2016. If none of the authors is registered by this date, the paper will be removed from the conference proceedings.

Registrations to the ISon2016 workshop include:


Early registration, before November 20th23rd 2016: Late registration, after November 20th23rd 2016:

Registration Procedure:

To register, please send an email to Susanne Strunk with Subject "ISon 2016 registration" providing your full name and the address to be used in the invoice.
To facilitate our planning, please indicate in your email also whether you will join the informal get-together on December 14th (at 7p.m. at Nichtschwimmer Bielefeld), (google maps) and whether you participate to the ISon 2016 social dinner on December 16th in Pappelkrug Bielefeld.
You will then receive the printed invoice while you're here in Bielefeld.

As to the payment, we have the following procedures (for EU / non-EU members).

For EU Members:

For Non-EU Members:


The ISon 2016 will take place at CITEC, Bielefeld University, Bielefeld, Germany:


Important note:

Please note that We are not able to organize any block-booked cheap accommodation. Participants will have to arrange their own travel and accommodation. We advise you to book accommodation early as it can be very difficult to find last-minute accommodation in Bielefeld.


Here you can find some convenient hotels:


Wednesday, 14th December 2016

For those who arrive on Wednesday, we will meet for some food and drink at Nichtschwimmer restaurant at 7pm ((google maps)). You can either let us know in advance or just simply show up. We will be there at least for a few hours.

Thursday, 15th December 2016

09:00 Registration at the registration desk of CITEC
09:30 Welcome
09:45 Parallel Workshop Session 1
HoloR: interactive mixed reality room

Business process sonification
12:00 Lunch Break
13:30 Parallel Workshop Session 2
BRIX2, modular physical computing prototyping for sonification design

Movement Fluidity
15:45 Coffee Break
16:15 Lab Tour
18:00 Bielefeld's Christmas Market 

Friday, 16th December 2016

09:00 Registration
09:30 Welcome
09:45 Keynote
10:20 Paper Session 1
Lowering the barriers to the creation of interactive auditory displays: an experimental investigation
Doon Macdonald and Tony Stockman
10:40 Coffee Break
11:10 Paper Session 2
Sonification of fluidity - an exploration of perceptual connotations of a particular movement feature
Emma Frid, Ludvig Elblaus and Roberto Bresin

Interactive sonification of the U-disparity maps of 3D scenes
Piotr Skulimowski, Mateusz Owczarek, Andrzej Radecki, Michal Bujacz and Pawel Strumillo

Sonifying the periphery: supporting the formation of gestalt in air traffic control
Niklas Rönnberg, Jonas Lundberg and Jonas Löwgren

Interactive sonification of movement qualities - a case study of fluidity 
Antonio Camurri, Andrea Cera, Stefano Piana, Corrado Canepa, Paolo Alborno, Gualtiero Volpe, Ksenia Kholikalova, Radoslaw Niewiadomski and Maurizio Mancini
12:30 Lunch
14:00 Paper Session 3
Discrimination of tremor diseases by interactive sonification
Marian Weger, David Pirrò, Alexander Wankhammer and Robert Hoeldrich

Interactive sonification for structural biology and structure-based drug design
Holger Ballweg, Agnieszka Bronowska and Paul Vickers

Heart alert: ECG sonification for supporting the detection and diagnosis of ST segment deviations
Andrea Aldana, Thomas Hermann and Steffen Grautoff

Collaborative study of interactive seismic array sonification for data exploration and public outreach activities
Masaki Matsubara, Yota Morimoto and Takahiko Uchide
15:20 Poster Craze
15:30 Coffee Break

Poster Session
Interactive sonification for visual dense data displays
Niklas Rönnberg and Jimmy Johansson

Interactive sonification of colour images on mobile devices for blind persons - preliminary concepts and first tests
Andrzej Radecki, Michal Bujacz, Piotr Skulimowski and Pawel Strumillo

La Macchina v0.6: realtime sonification of a painted conveyor paper belt
Alessandro Inguglia and Sylviane Sapir 

An exploration of interaction techniques for the presentation of foreground and background items in auditory displays
David Dewhurst and Tony Stockman

Slowification: an in-vehicle auditory display providing speed guidance through spatial panning
Jan Hammerschmidt and Thomas Hermann

Interactive Sonification of Gait: Realtime BioFeedback for People with Parkinson’s Disease 
Margaret Schedel, Lisa Muratori, Jay Loomis, Tzvia Pinkhasov, Ilene Berger Morris and Erin Vasudevan

17:15 Panel Discussion
17:55 Closing Words
18:30 Social Dinner
bar shadow