Hand Gesture Based Mouse Control and Drawing - WaveClick

Votes: 4
Views: 801

"Hand Gesture Based Mouse Control and Drawing: WaveClick" is an innovative project developed using the Python programming language and the Mediapipe library. It aims to revolutionize the way people interact with computers by providing an intuitive and hands-free method of controlling the mouse cursor and drawing on the screen through hand gestures.

The project leverages the power of computer vision and machine learning to accurately track and interpret hand movements in real-time. By utilizing the capabilities of Mediapipe, a versatile framework for building multimodal applied ML pipelines, the project enables the recognition and analysis of various hand gestures and movements.

WaveClick incorporates a webcam as its input source, capturing live video feed of the user's hand. The captured video frames are then processed using Mediapipe's Hand Tracking module, which detects and tracks the landmarks of the hand, such as fingers, palm, and wrist.

Once the hand landmarks are identified, the project utilizes a custom gesture recognition algorithm to interpret the gestures made by the user. This algorithm takes into account the relative positions of the hand landmarks and their movements over time to recognize a set of predefined gestures. These gestures include actions like moving the cursor, left-clicking, right-clicking, and dragging.

To control the mouse cursor, the project maps the position of the hand in the captured video frame to the corresponding position on the computer screen. By moving their hand in the air, users can move the cursor on the screen without the need for a physical mouse. This provides a more natural and intuitive way of interacting with computers, especially in scenarios where traditional input devices may be impractical or inaccessible.

Furthermore, WaveClick allows users to perform actions such as left-clicking, right-clicking, and dragging by making specific hand gestures. For instance, a user can simulate a left-click by closing their hand into a fist or perform a right-click by extending their index finger while keeping the other fingers curled. These gestures provide a seamless and effortless way to perform mouse actions.

In addition to mouse control, WaveClick also enables users to draw on the screen using hand gestures. By leveraging the positional data of the hand landmarks, users can create strokes and shapes simply by moving their hand through the air. This feature opens up creative possibilities for artists, designers, and anyone who wants to explore a new form of digital drawing.



Voting is closed!


  • Name:
    Arnav Modanwal
  • Type of entry:
    Team members:
    • Hepil Italiya
    • Krushi Monpara
  • Software used for this entry:
    Python IDE, Jupyter Notebook, VS Code, PyCharm
  • Patent status: