Abstract

This paper proposes a virtual mouse system based on HCI using computer vision and hand gestures.Techniques for establishing the process of human-computer interaction(HCI) have evolved since the invention of computer technology. The mouse is its great invention in HCI (Human-Computer Interaction) technology. Wireless or Bluetooth mouse technology is still in development, but the technology is not yet completely device-free. The Bluetooth mouse requires battery power and a connection dongle. The presence of additional devices in the mouse makes it difficult to use. The proposed mouse system solves these limitations. We have written a program for controlling the mouse movement using Python and OpenCV with a real-time camera that detects hand patterns, tracks hand gesture patterns that replaces the work of a traditonal physical mouse. Gestures captured with a integrated camera or webcam are processed with recognition technology. The user can control some of the computer's cursor functions with hand gesturing movements. Primarily, users can left-click, right-click, and double-click by scrolling their hand up or down with various gestures. This system captures frames using a webcam or built-in camera, processes the frames to make them trackable, recognizes various gestures made by the user, and performs mouse functions. Therefore, the proposed mouse system eliminates dependence on device to use the mouse. So the development of HCI technology can help.