Synchronicity: A Bio-Graphic Notation System

Keywords: Biofeedback, Graphic Score, Data Visualization, Data Sonification, Improvisation

Description:

Synchronicity is an innovative music performance system that transforms real-time biofeedback data—specifically systolic and diastolic blood pressure and heart rate—into a dynamic graphic notation. This notation guides live ensemble performances, creating a unique improvisational environment driven by physiological signals. As a proof-of-concept for "bio-graphic" notation, Synchronicity investigates how artistic applications of biofeedback can help individuals understand, influence, and embrace their current physiological and psychological states.

This project was developed in the course "Reimagining Hyperinstruments" at the Massachusetts Institute of Technology.

Performance Date: December 11, 2021 | Venue: MIT Media Lab

Roles: Conceptualization / Project Management / Programming (C#, Max/MSP) / Sound Design

Team Members: J. Aguera (MIT) / C. Liu (Berklee College of Music) / B. Samsurya (Berklee College of Music) / X. Hong (Harvard University)

System Overview

Experiencer → A volunteer seated in the center of the room, wearing LED fast-flashing glasses. All biofeedback sensors are attached to this individual, and their experience directly mediates the graphic notation/score.

Graphic Score → Via OSC, Unity receives data from the sensors and maps it to specific parameters in the scene.

Ensemble → Musicians who observe subtle changes in the scene and respond through their performance.

Notation

low blood pressure

high blood pressure

Performance

Sarah Marie Bugeja

Voice

Hidemi Akaiwa

Keyboard

Ransom McCafferty

Tabla

Previous
Previous

Cobra

Next
Next

Auditory Statistical Learning: Experiment 1 & 2