Control your computer without touching a mouse!
This project uses computer vision to track hand movements in real-time and converts them into mouse actions like cursor movement and clicks.
- Real-time hand tracking
- Move cursor using finger movement
- Perform click actions using gestures
- Smooth and responsive interaction
- Uses a webcam to capture live video feed
- Detects hand landmarks using a hand tracking model
- Maps finger positions to screen coordinates
- Recognizes specific gestures for actions like clicking
- Python
- OpenCV
- MediaPipe
- PyAutoGUI
- Mapping camera coordinates to screen space accurately
- Reducing jitter for smoother cursor movement
- Handling different lighting conditions for reliable detection
- Add gesture-based volume/brightness control
- Improve tracking accuracy
- Add multi-hand support
- Build a small UI overlay for better feedback
- Clone the repository
- Install dependencies:
pip install opencv-python mediapipe pyautogui
- Run the script:
python main.py
Make sure to change ppt path! ppt_path = r"C:\Users\admin\OneDrive\Documents\virtual_mouse.pptx"