The task of processing raw 3D data to establish the fingertips and eventually the pose of the hand is quite a challenging problem.

We have built a few systems for providing this level of detail where the SDK’s provided don’t do exactly what we need.

This video shows using the position of the fingertips and then the angle of the fingertip to navigate a menu system. We are also using a swipe gesture to hide the menu.