This project was made using a Leap Motion sensor. The sensor itself is designed to track hands. The Max patch I am using tracks just the fingertip data, converts that into a MIDI signal, then outputs that through a cycle object to produce sound. The tracking component of the patch is from the downloadable Leap-Max file that Jesse posted on the Slack, and the sound production is based off of Jesse class demo of the Leap Motion sensor.
The exact way that this works is the patch tracks the x-y-z data of the fingertip. X data is pitch, Y data is on/off, and Z data is volume. I designed this to act as closely to a piano keyboard as possible, which is why the Y data controls the on/off of the sound. This simulates the action of pressing down a key.
https://drive.google.com/drive/folders/1gxu0LY6NpyEr03aOj5RZeaOhtDbv_HCa?usp=sharing