KeyFrame extraction based on face quality measurement and convolutional neural network for efficient face recognition in videos Rahma Abed 1 & Sahbi Bahroun 1 & Ezzeddine Zagrouba 1 Received: 28 June 2019 /Revised: 24 May 2020 /Accepted: 21 July 2020 # Springer Science+Business Media, LLC, part of Springer Nature 2020 Abstract Indexing is the process of extracting a compact, significant and pertinent signature that describes the content of the data. This field has a broad spectrum of promising applica- tions, such as the Face in Video Recognition (FiVR). Motivating the interest of re- searchers around the world. Since the video has a huge amount of data, the process of extracting the relevant frames becomes necessary and an essential step prior to performing face recognition. In this context, we propose a new method for extracting keyframes from videos based on face quality and deep learning for a face recognition task. The first step is the face detection using MTCNN detector, which detects five landmarks (the eyes, the two corners of the mouth and the nose). It limits face boundaries in a bounding box, and provides a confidence score. This method has two steps. The first step aims to generate the face quality score of each face in the data set prepared for the learning step. To generate quality scores, we use three face feature extractor including Gabor, LBP and HoG. The second step consist on training a deep Convolutional Neural Network in a supervised manner in order to select frames having the best face quality. The obtained results show the effectiveness of the proposed method compared to the methods of the state of the art. Keywords Keyframe extraction . Face quality assessment . Face in Video Recognition . Convolution Neural Network . Content Based Video Retrieval Multimedia Tools and Applications https://doi.org/10.1007/s11042-020-09385-5 * Rahma Abed rahma.abed@etudiant–isi.utm.tn Sahbi Bahroun sahbi.bahroun@isi.utm.tn Ezzeddine Zagrouba ezzeddine.zagrouba@uvt.tn 1 Laboratoire LIMTIC, Institut Suṕerieur d’Informatqiue, Universit́ e de Tunis El Manar, 2 Rue Abou Rayhane Bayrouni, 2080 Ariana, Tunisie