cuSketch

For my undergraduate thesis, I worked on the expansion of CsoundUnity - a real-time synthesis solution for audio-oriented Extended Reality. cuSketch is a library containing utility classes, sketches/examples, and applications created using these tools.

Contributors: Caio Jiacomini (Utility Classes, Sketches, App #1), Dr. Richard Boulanger (App #1).

Thesis Advisor: Akito van Troyer (491) / Dr. Richard Boulanger (401)

  • A series of C# utility classes that enable the development of audio-oriented applications abstracting the code into a comprehensive easy-to-use interface.

  • A set of simple models and explorations with CsoundUnity.

    Sketches serve as a starting point for the development of new ideas and programs.

  • Gardening as an interface for musical expression. A recontextualization of the 1978 computer music piece “Trapped in Convert” By: Dr. Richard Boulanger.

  • Using parametric and non-linear equations systems to modulate audiovisual parameters.

C# Utility Classes: no-code solutions

  • Sender

    Communicates Unity and Csound by sending Score Event, Dynamic P-field, Channel, and Preset data to the specified CSD file

  • Transform and Physics

    Maps physical data (e.g. position, scale, rotation, speed, and angular speed) to any specified parameter of the CSD file

  • Modulator

    Modulates any parameter from Unity or Csound through the use of parametric equations, strange attractors, and custom-made splines

  • Audio Reactive

    Maps FFT-based data from any given CsoundUnity instance to the scale, material, or shader of a selected GameObject

  • Slider

    Converts any GameObject into a functional multi-channel slider/knob that updates every frame or only when the value changes

  • Space Time

    Positions GameObjects and sequences events (e.g. triggering an instrument) based on a mathematial sequence (e.g. Fibonacci or Recaman)

  • Live-Input Processing

    Maps Live Input (e.g. microphone) into any CSD parameter with the option of triggering other components such as a particle system

Research Paper

Sketches / Examples / Tutorials

introductory sketches: mapping position, speed, and triggering presets

sonic sketcher, chaotic/parametric modulation, and sample-processing

audio reactivity and live-input

Trapped in the Garden (App #1)

Gardening as an interface for musical expression. A recontextualization of the 1978 computer music piece “Trapped in Convert” By Dr. Richard Boulanger.

A Body-Centered Interface for electroacoustic performance and composition

Trapped in the Garden Split-Screen

The Garden: A procedurally-generated environment

The Garden at the 6th International Csound Conference Athlone, Ireland

Modulation Class: Modulator

Description: A set of strange attractors and parametric equations that can modulate any audiovisual parameter in Unity.

Potential Uses:

  • Spatialize any Audio Source in 3D space (Object displacement)

  • Modulate any sonic parameter in real-time (3D LFO-like)

  • Modulate any visual parameter in real-time (3D LFO-like)

Four Wing Attractor:

X position = Pitch Oscillator 1

Rossler Attractor:

X position = Vibrato Frequency & Amplitude, Pulse Width, Pan

Y position = Filter, Distortion

Lorenz Attractor:

Z position = Pitch Oscillator 2, Pitch Oscillator 3, Dry/Wet