Music interface
Working prototype
Ondéon
Ondéon uses Apple Vision hand tracking to control pitch and volume. Its virtual MIDI output can play instruments in Logic, MainStage, Ableton, or another music application.
- Role
- Product and engineering
- Format
- Native macOS application
Track the hand, send MIDI
The camera tracks hand position and maps it to pitch, volume, tuning, and MIDI CC controls. A virtual MIDI port sends the result to a separate instrument.
Current prototype
Hand tracking, MIDI output, tuners, and control mappings are working in the native app. I am still refining how the instrument should feel to play.