This is my first attempt at converting hand motion to interactions.
Inspired by the beautiful concept designed by @EhsanRahimi for a counter interaction.
To generate moving Up, Down, Left, and Right events, I am using the fingertip's direction and velocity.
The demo uses Mediapipe hand tracking framework integrated with Unreal Engine 5
Data from the phone is transmitted over a TCP server.
Feedback is appreciated.