1 Gesture and Face Recognition for an Interactive email System Mahdi Babaei, Wong Chee Onn, Lim Yan Peng Faculty of creative multimedia Multimedia University Cyberjaya, Malaysia mahdi.babaei@gmail.com Abstract— This is a project to develop an e-mail application using HCI features helping users check their mailbox easier. It is consist of a network module to develop a standalone email application to ask user login and access user’s mailboxes; a face recognition module Face recognition algorithm and pick the fastest one to avoid lag and use it as a security level of application. The final phase is a study on HCI features would be developed on application and found gestures could be added to the system for ease of interaction. The contribution of this project includes gesture recognition in digital space by color tracking and reliable login system. Keywords-Gesture recognition; Face recognition; Email; Interactive; Blob detection; I. INTRODUCTION From early 1990s that email came to people’s life [2] they had debated on how to use such systems. To check email frequently had turned to one of their routines quickly. Their problem was mostly with the configuration of standalone applications that was not easy for people with low knowledge about computers. Complex menus led to user confuse and boredom. There was also a problem for user who were willing to check their emails using computers in public to make sure that other people cannot see their fingers while entering password or they had not left the system in a condition that next user who is wondering to do the same thing can access their emails. In another word they need a security guard make them feel safe to use such computer to access their personal information in their emails and to be fast also. Different types of users have variety of expectations but there is a forgotten group of people who had less being considered by application developers and companies. From another perspective it is not easy for people with disability to use normal devices in order to check their emails. Imagine difficulties may someone who had lost his hands fingers in an accident and wants to check his emails, may encounter. Such people need an easy way of interaction with computers rather than normal devices, which is provided by HCI and had not developed in this field yet. In order to cover such user needs an application has designed based on 2 main modules. First is a security level in order to detect and recognize the user face and perform login action. Second is a tracking system, which is based on color detection, and tracking in order to help user interact with system easily. The contribution of this project includes gesture recognition in digital space by color tracking and reliable login system. II. LITERATURE REVIEW There are many standalone email applications available in world’s software market. Microsoft outlook is absolutely the most powerful standalone application tool in compare of others. Apple iMail is also another example which is popular recently. The main disadvantage with almost all standalone email applications would be the complexity of menus and low interactivity. Although application configuration has always consist of complicate instructions but named applications have complexity even in interface or simple functions. The result of this project should consist of interactive design, reliable login system and very easy user friendly menus. Face recognition login system increases security (du to use of human biometrics) and easier to use with higher interactivity level. A. Face Detection and recognition An email system considers as a personal private property now days. In order to secure usage of such system it is vital to have a secure login module. This study has based on Interactivity of a system and it means to choose an interactive secure login system. Based on researches [3],[4] the most reliable and secure ways to login a system is using human body biometrics varies from finger prints[5], eye Irish[6] (scan and recognition), eye retina[7] (scan and recognition), Head scan[8] and Face recognition[9]. Among all options mentioned above face recognition is the only option that can work as a security module with least failure rate and its reliability. Face Recognition from image is an algorithm to identify faces from an image by extracting landmarks or features of the subject's face[9]. This technique firstly detects faces available in the photo that it receives from webcams or sensor. In next step it tries to recognize it by building up a comparison between photo of the face and what it has in its database to see whether can find a match case or not. This technique is very popular today because of low cost and good performance. In today world most of people carry their own laptops around and most of their laptops has been equipped by even a simple webcam. Microsoft developed this method of login for users from windows vista version. There are several available algorithms available that for this reason we need the one with fewer lags. There are three main categories generally: