Melody
Overview
Interaction System
ROLE — Physical computing, interaction design, and sound system design. OUTCOME — Breath controls three virtual singers in real time through Arduino, Unity, and FMOD. VALIDATION — The prototype confirmed immediate cause-and-effect between airflow and sound; next step: calibration and accessibility testing across different breath strengths.
Character System
Each singer gives the system a distinct voice, helping sound feel embodied rather than abstract. Sketches, vectors, and 3D models turn audio control into a small cast of performers.
Sound 1 · sings an octave higher
Sound 2 · sings an octave lower
Sound 3 · mixes the voices
Final Experience
Breath directly changes the performance in real time, making the interaction feel immediate, physical, and easy to understand.
(This video includes sound. Click to play.)
Build Process
