Journal of Information Security and Applications 48 (2019) 102373 Contents lists available at ScienceDirect Journal of Information Security and Applications journal homepage: www.elsevier.com/locate/jisa Human identification after plastic surgery using region based score level fusion of local facial features Tanupreet Sabharwal a,b,∗ , Rashmi Gupta c a USICT, GGSIPU, Delhi, India b Department of Electronics and Communication Engineering, Northern India Engineering College, New Delhi, India c Department of Electronics and Communication Engineering, Ambedkar Institute of Advanced Communication Technologies and Research, New Delhi, India a r t i c l e i n f o Keywords: Facial recognition after plastic surgery (FRAP’S) American society of plastic surgeons (ASPS) Regions of interest (ROIs) Speeded up robust features (SURF) K-nearest-neighbour (KNN) Weighted score level fusion Expected error rate (EER) Recognition rate (RR) Computation time (CT) a b s t r a c t Plastic surgery alters original facial features of an individual thereby making Face Recognition after plastic surgery difficult. Cosmetic procedures introduce geometrical deviations which are difficult to analyze by state of the art facial identification procedures. Here a region based score level fusion approach for local facial features is proposed to equalize former and latter surgery images. Steps involved in the recognition process are; firstly identifying the ROIs (areas/regions of interest/concern) of before and after surgery images. ROIs are eyes, nose and mouth regions; feature extraction from identified regions via Speeded Up Robust Features and K Nearest Neighbour techniques; region wise and full face geometrical distance calculation between matched feature vectors of pre and post surgery image samples by a distance met- ric (sum of squared differences); final recognition rate calculation by weighted score level fusion. The projected procedure gives recognition of 89.7% for local surgical treatment and 87% for global surgery. © 2019 Elsevier Ltd. All rights reserved. 1. Introduction FRAP’S has received considerable notice from researchers of di- verse domains such as biometrics, pattern detection and computer vision communities. Synthetic surgery measures provide a skillful and durable way to improve one’s external appearance by mod- ifying facial feature defects and improving the texture of facial membrane/skin to get an attractive and youthful appearance. Aside from beautification, synthetic surgical operations are advantageous for patients suffering from diverse physical ailments caused due to extreme enlargement of facial tissues. The geometry of hu- man facial features is altered by these cosmetic procedures [3,14]. American Society of Plastic Surgeons is the world’s biggest soci- ety of specialized cosmetic medical doctors. It is a leading infor- mative source for visual and reconstructive plastic surgery. A sur- vey according to ASPS for the year 2017 stated that amongst 1.8 million beauty/cosmetic therapies executed in 2017, the peak five were Liposuction (246,354 surgeries, upbeat 5% from 2016), Rhino- plasty (218,924 therapies, downward 2% from 2016), Blepharoplasty (209,571 therapies, more or less the same as in 2016) and Tummy tuck (129,753 surgeries, up 2% from 2016). Amongst 15.7 million therapies performed in 2017, the top ones were Botox insertions (7.23 million therapies, up by 2% from 2016), ∗ Corresponding author. E-mail address: kaurtanupreet86@gmail.com (T. Sabharwal). Soft Tissue Insertions (2.69 million therapies, up by 3% from 2016), Synthetic Peels (1.37 million surgeries, up by 1% since 2016), Laser hair elimination (1.1 million surgeries, down by 2% from 2016), Micro/Major Dermabrasion (740,287 surgeries, down by 4% from 2016). Tummy tucks, which came down from the peak five most popular synthetic therapies in 2016, were back in 2017. There were approximately 2000 more tummy tuck surgeries in 2017 as com- pared to 2016. Tummy tucks eradicate surplus fat/skin and refur- bish fragile muscles to create a superior abdominal contour. Non- invasive fat therapies and body sculpting are in trend these days. People are choosing more and more to delineate diverse parts of their physique. Techniques to get rid of fat and stiffening of skin tissues are gaining fame, with cellulite treatments nearly up by 20% over the last year. Currently fat reduction and skin tighten- ing therapies are drawing wide attention. Fat elimination thera- pies that use an unique expertise to "ice over" fat without surgical treatment have an upshot of nearly 7%. Cellulite healing surgeries improved by 19% by using lasers to get rid of unwanted fat. Skin stiffening methods that target fat and firm sagging facial muscles augmented by 9% [2]. Fig. 1 shows an instance of the outcome of synthetic surgi- cal treatment on an individual. Bhatt et al. [3] stated that non- linear deviations introduced by cosmetic therapies make human identification after surgery complex. Varying facial geometry and skin quality in human beings enlarges the intra class changeability amid before and after surgery imagery of the same human being https://doi.org/10.1016/j.jisa.2019.102373 2214-2126/© 2019 Elsevier Ltd. All rights reserved.