Reality Synthesizer utilizes iOS 15.4's addition of the LiDAR sensor to AVFoundation to visualize MIDI notes played on a connected synthesizer. The notes are visualized in augmented reality as the music is played. The demo uses a couple Metal shaders for depth-based visuals.
Show HN: Visualize MIDI notes in augmented reality using iOS LiDAR devices | Heykuki News