Sonification

Time

My Role

4 months

UX Designer & Researcher

Main tasks

Generative research, interviews, survey, data analysis, experiment protocol design

Tools

Ableton, Touch Me, Miro, Excel

In a Snapshot

The problem

A relatively new research area in Human-Computer Interaction (HCI) is movement sonification, which consists of converting movement-related data into sounds.

This technique finds various applications, including well-being and rehabilitation, performative arts, and even creativity training.

In this work, we propose a novel system to explore the impact of sonification on the willingness to engage in physical contact.

This is an individual project designed and developed during the Nonverbal Behavior and Interaction course at the University of Trento - within the Human-Computer Interaction Master's Degree.

The solution

Starting from a great interest in designing physical interactions and sound interactions, I designed the project on my own.

Prof. Radoslaw and I investigated the impact of sonification on the willingness for physical contact. For this purpose, we introduce a novel system designed to explore this impact within a performative art setting.

It consists of a MIDI controller which detects physical contact between two dancers and transforms it into sounds. We used it in a preliminary experiment.

Three sonification strategies are explored with 10 participants. Questionnaires, interviews and quantification of touches were utilized to compare experimental conditions.

The process

Survey design

Ideate

Perform the

Experiment

Data analysis

Here you find the

Article