08

Hand-Control-Mouse — Driving the computer by hand

IFRI AI club project, built with a team of juniors: controlling the mouse with hand gestures using MediaPipe. I coded, mentored the team and designed the mapping between gestures and actions.

Stack

PythonMediaPipeOpenCVPyAutoGUI

What happened?

  1. 01

    The question

    Can your hand replace the mouse, with nothing but a webcam?

  2. 02

    The build

    Webcam capture with OpenCV, hand keypoint detection with MediaPipe Hand Landmarker, gesture recognition, then mapping gestures to mouse actions through PyAutoGUI.

Spider-Verse · homage