The project’s primary aim is to improve the scope of human and computer interaction by developing an effective alternative way of controlling the mouse pointer and its various functions such as left click, right click, scroll up, scroll down and selection. It can also be used at home by users for recreational purposes like while watching movies or playing games. The project can be useful for various professional and non-professional presentations.

It retrieves necessary data and implements it to the mouse interface of the computer according to predefined notions.

It uses a program in python and various libraries such as PyAutoGUI, Numpy and image processing module OpenCV to read a video feed which identifies the users’ fingers represented by three different colors and track their movements. The task here is to control the mouse even from a distance just by using hand gestures. It aims to provide the user a better understanding of the system and to let them use alternate ways of interacting with the computer for a task. The project “Mouse control using Hand Gestures” is developed aiming to better the process of human-computer interaction. Their centers are calculated using method of moments and depending upon their relative positions it is decided that what action is to be performed.įigure 2.2 Video capture and cursor movementįigure 2.3 Hand gesture guide for mouse control Video captures by the webcam is processed and only the three colored finger tips are extracted. Thus, in addition to a webcam (which almost all laptops are already loaded with) a computer needs to be pre-equipped with the following packages for the project to run such as: It uses of the cross-platform image processing module OpenCV and implements the mouse actions using Python specific library PyAutoGUI. The project is essentially a program which applies image processing, retrieves necessary data and implements it to the mouse interface of the computer according to predefined notions. How better would it be if you could control your mouse from wherever you were? Well, we have a solution! You must move across the whole stage to the podium to use your mouse. You are giving a presentation on a projector and need to switch between applications. You must get off your place to pause the movie. You are watching a movie with your friends on a laptop and one of the guys gets a call. The predefined gestures make use of only three fingers marked by different colors.

Simply speaking, a camera captures your video and depending on your hand gestures, you can move the cursor and perform left click, right click, drag, select and scroll up and down. This project is a mouse simulation system which performs all the functions performed by your mouse corresponding to your hand movements and gestures. Control Mouse pointer using hand gestures

Calibrate mouse pointer windows 7