Hybrid Approach for Facial Feature Extraction Amit Kaul Electrical Engineering Department National Institute of Technology Hamirpur Hamirpur, H.P., India. Sushil Chauhan Electrical Engineering Department National Institute of Technology Hamirpur Hamirpur, H.P., India. A. S. Arora Electrical and Instrumentation Department, Sant Longowal Institute of Engineering & Technology, Longowal, Sangrur, Punjab, India Abstract— Human face in addition to revealing the identity of an individual also provides information regarding his/her emotional and psychological state. In addition to this various facial features are utilized in applications like biometrics (face, iris and lips), automatic lip-reading, speech recognition etc. For accomplishing these tasks reliable face and facial feature detection methods are required. In this work a hybrid facial feature extraction approach based on wavelets and information from HSV and YCbCr color spaces has been presented. The main emphasis of this paper is to extract lip-region for further applications. The algorithm has been tested on images captured by different resolution cameras under varying illumination condition. Keywords— Wavelet, color spaces, lip localization I. INTRODUCTION Unconsciously in everyday life humans effortlessly capture tremendous amount of information from faces of one another such as recognizing each other, guessing emotional and health state of an individual while interacting with him or her. This wealth of information present in faces is utilized in numerous applications present in commercial and forensic domain like lip-reading, speech recognition, face biometrics etc. These applications in majority of the cases are based on facial features. For development of these processes keeping human machine perspective in mind reliable facial feature (eyes, nose and mouth or lips) detection mechanism is required. Robust facial feature detection is a challenging task because of the variability arising in images due to change in expression, gender, occlusion, illumination, pose etc. In this paper a hybrid approach is presented which utilizes the complementary information present in the wavelet domain and different color spaces for detection of face and extraction of three main facial features. The major emphasis has been on the localization of the lip region so as to utilize it for further applications like lip reading and lip based biometrics. The paper is organized as follows. This first section provides the introduction. Brief overview of methods employed for facial feature detection and applications that utilize information from lip region is presented in the next section. The proposed method is described in section III. Experimental results are shown in section IV and finally paper is summarized with a brief conclusion. II. RELATED WORK In order to extract the facial features face region is identified in a given image. Face detection has been carried out using wavelet and color spaces [1, 2]. Extraction of facial features particularly lip localization is a difficult task. In general techniques utilized for solving this problem can be grouped under three headings (a) image based methods comprising of color based methods and subspace methods, (b) model based methods and (c) hybrid methods. Lip –prints have been extensively studied in dental forensics [3, 4] but machine based lip print recognition is relatively new area. L. Smacki and et. al have suggested the use of Hough transform for automatic lip print recognition using scanned lip-print images [5]. S. Bhattacharjee and his fellow researchers have used canny edge detector to generate region specific edge datasets for identifying four individuals [6]. E. Gomez and et.al on the other hand have used lip shape based features such as height and width of lips and polar coordinates of lip envelope for biometric identification [7]. M. Choras has also employed lip shape features like geometrical parameter of lip area, ratio of lower and upper lip height etc. and lip color features (maximum, minimum, mean intensity etc.) for human identification [8, 9]. As far as human recognition using digital images acquired from camera is concerned K. S. Baik and his colleagues have proposed a scheme in which multi-resolution architecture is used for person identification. The local pattern masks in horizontal vertical and diagonal direction are used to find the similar pattern in input image. Based on the statistical factors (mean and standard deviation) feature vector is obtained [10]. III. METHODOLOGY ADOPTED Facial feature extraction first requires localization of the face in a given image. After this one of the key points out of eyes, nose or lips are detected and considering this as reference other features are located [11, 12, 13]. In order to highlight the edge information of different facial features properties of two-dimensional wavelet transform are exploited [14.15]. Two dimensional wavelet transform uses a two dimensional scaling function φ(x, y) and International Journal of Engineering Research & Technology (IJERT) ISSN: 2278-0181 Published by, www.ijert.org ACMEE - 2016 Conference Proceedings Volume 4, Issue 15 Special Issue - 2016