About the Project
A Python program that utilizes an AI (Google's Mediapipe Library) that lets you play Minecraft using hand signs. This program tracks your hand movements using AI and translates them into in-game actions. In short, you can do anything a mouse and keyboard can do.
How it Works
- The program accesses your webcam live feed.
- MediaPipe’s “Hands” module detects your hand and localizes key landmarks (e.g. fingertips, joints, palm) in each frame.
- A gesture recognition system uses those landmarks to classify what gesture you’re making (e.g. open hand, fist, pointing, fingers up/down, etc.).
- Based on the recognized gesture, the program simulates keyboard and/or mouse input (e.g. move forward/back, jump, place blocks, look around, etc.), allowing you to control the game without traditional input devices.
- Because recognition and input mapping happen in real-time, gameplay feels fluid and responsive (given good lighting and correct gesture execution).