April 1, 2008 17:16 World Scientific Review Volume - 9in x 6in chapter12 Chapter 12 Face Analysis Using Local Binary Patterns A. Hadid * , G. Zhao, T. Ahonen, and M. Pietik¨ ainen Machine Vision Group Infotech Oulu, P.O. Box 4500 FI-90014, University of Oulu, Finland http://www.ee.oulu.fi/mvg Local Binary Pattern (LBP) is a simple yet very efficient texture opera- tor which labels the pixels of an image by thresholding the neighborhood of each pixel with the value of the center pixel and considers the result as a binary number. Due to its discriminative power and computational simplicity, LBP texture operator has become a popular approach in var- ious applications. This chapter presents the LBP methodology and its application to face image analysis problems, demonstrating that LBP features are also efficient in nontraditional texture analysis tasks. We explain how to easily derive efficient LBP based face descriptions which combine into a single feature vector the global shape, the texture and eventually the dynamics of facial features. The obtained representations are then applied to face and eye detection, face recognition and facial expression analysis problems, yielding in excellent performance. 12.1. Introduction Texture analysis community has developed a variety of approaches for dif- ferent biometric applications. A notable example of recent success is iris recognition, in which approaches based on multi-channel Gabor filtering have been highly successful. Multi-channel filtering has also been widely used to extract features e.g. in fingerprint and palmprint analysis. How- ever, face analysis problem has not been associated with progress in texture analysis field as it has not been investigated from such point of view. * Corresponding author: hadid@ee.oulu.fi, Phone:+358 8 553 2809, Fax:+358 8 553 2612 347