GESTURE CONTROLLED APPLICATION USING KINECT

Abstract

The Gesture Controlled Application (GCA) has been developed in C# with the aid of Kinect for windows SDK 1.6 and EmguCV (Wrapper of OpenCV in .NET). The application provides two types of gesture recognition, Hand gesture recognition and Body gesture recognition. In the former, we have developed an algorithm that recognizes different hand orientations irrespective of the body joints using EmguCV to extract hand features including contours, convex hulls and convexity defects. In the latter, we have used DTW (Dynamic Time Warping) algorithm for the classification of body gestures using already trained examples and upper body joints information at runtime. The salient feature of our application is that it can be integrated with many of the windows apps that use mouse and keyboard. Moreover a user can customize gestures according to his/her will. In other words, the user can train the Kinect to recognize only a specific set of gestures trained by the user himself which can prove to be a key application for security purposes in home/office automated systems using Kinect.