The field of Human-Computer Interaction (HCI) has seen a great amount of growth in the last couple of decades. People use mouse, keyboard, track pad, joysticks to communicate with the computer. Nowadays, they have used a wireless devices example wireless mouse or wireless keyboard. One disadvantage of these devices is required Bluetooth hardware attached with computer and respective software device also. The new technology touch screen comes in the market which is used in HCI (Human Computer interaction) but a cost of a touch screen is not cheap. That’s why the use of such technology is limited. The proposed system has no such disadvantage. The system goes through two phases color calibration and mouse events. Main intention of this project is to develop Human Computer Interaction device to use efficiently, where user can control mouse button click and moving pointer position using the color detection.