The „Resonance“ project merges audio and visual elements into a seamless, interactive live performance. At its core, the DJ uses an MIDI controller to simultaneously manage both layers, audio and visual performance. Musical signals are transmitted in real time to Unreal Engine using low-latency tools like loopMIDI and rtpMIDI. Within Unreal, these MIDI signals are converted into dynamic commands via the node-based Blueprint Visual Scripting system.

This technical setup enables the precise control of a range of visual effects, such as Niagara Particle Systems for complex particle animations, Alembic animations for detailed 3D object movements, specialized material effects, and post-process camera effects, all synchronized to the musical performance. The modular architecture allows the DJ to flexibly adapt visual components on the fly, creating an immersive, interactive show where audio and visuals react in perfect harmony.