ISSN (O) 2393-8021, ISSN (P) 2394-1588 IARJSET International Advanced Research Journal in Science, Engineering and Technology Vol. 8, Issue 7, July 2021 DOI: 10.17148/IARJSET.2021.8756 © IARJSET This work is licensed under a Creative Commons Attribution 4.0 International License 275 Facial Emotion Recognition and Detection in Python Using Deep Learning Nikhil Rai 1 , Dhirender Gulair 2 , Jawad Shiningwala 3 , Mayuri H. Molawade 4 Students, Department of Computer Engineering, Bharati Vidyapeeth (Deemed to be University) College of Engineering, Pune, India-411043 1,2,3 Assistant Professor, Department of Computer Engineering, Bharati Vidyapeeth (Deemed to be University) College of Engineering, Pune, India-411043 4 Abstract: Human facial emotion recognition (FER) has attracted the eye of the research network for its promising applications. Mapping one of a kind facial expressions to the respective emotional states are the primary task in FER. The classical FER consists of two most important steps: feature extraction and emotion recognition. presently, the Deep Neural Networks, particularly the Convolutional Neural network (CNN), is extensively used in FER with the aid of distinctive feature of its inherent feature extraction mechanism from pictures. numerous works were reported on CNN with only some layers to clear up FER issues. but, wellknown shallow CNNs with straightforward getting to know schemes have restricted characteristic extraction capability to seize emotion data from high-resolution pictures. A notable disadvantage of the most current techniques is that they consider only the frontal pictures (i.e., ignore profile perspectives for convenience), despite the fact that the profile perspectives taken from different angles are essential for a practical FER system. For growing a highly correct FER system, this study proposes a completely Deep CNN (DCNN) modeling thru transfer learning (TL) technique wherein a pre-skilled DCNN model is followed through changing its dense top layer(s) well suited with FER, and the model is great-tuned with facial emotion data. a novel pipeline strategy is brought, wherein the training of the dense layer(s) is accompanied via tuning each of the pre-skilled DCNN blocks successively that has brought about gradual improvement of the accuracy of FER to a better level. Keywords: convolutional neural network (CNN); deep CNN; emotion recognition; transfer learning I. INTRODUCTION Human beings regularly have different moods and facial expressions changes consequently. Human emotion recognition performs a completely crucial role in social relations. the automated recognition of emotions has been an active analysis subject matter from early eras. in this deep learning system user’s emotions using its facial expression can be detected. real-time detection of the face and deciphering different facial expressions like happy, sad, angry, afraid, surprise, disgust, and neutral. and many others. This system can locate six different human emotions. The trained model is capable to hit upon all of the noted emotions in real-time. an automated facial expression recognition system has to carry out detection and site of faces throughout a cluttered scene, facial feature extraction, and facial expression classification. The facial expression recognition system is enforced victimization of Convolution Neural network (CNN). A CNN model is trained on FER2013 dataset. FER2013 Kaggle faces expression dataset with six facial features labels as happy, sad, surprise, fear, anger, disgust, and neutral is used during this project. as compared to the alternative datasets, FER has extra variant within the pictures, which includes face occlusion, partial faces, low- contrast pictures, and eyeglasses. This system has capability to monitor human beings emotions, to discriminate among emotions and label them accurately and use that emotion information to guide thinking and behavior of specific individual. II. LITERATURE REVIEW Facial expression is the common signal for all humans to convey the mood. There are many attempts to make an automatic facial expression analysis tools as it has application in many fields such as robotics, medicine, driving assist systems, and lie detector. Since the twentieth century, Ekman et al. defined seven basic emotions, irrespective of culture in which a human grows with the seven expressions (anger, feared, happy, sad, contempt, disgust, and surprise). In a recent study on the facial recognition technology (FERET) dataset, Sajid et al. found out the impact of facial asymmetry as a marker of age estimation. Their finding states that right face asymmetry is better compared to the left face asymmetry. Face pose appearance is still a big issue with face detection. Ratyal et al. provided the solution for variability in facial pose appearance. They have used three-dimensional pose invariant approach using subject-specific descriptors. There are many issues like excessive makeup pose and expression which are solved using convolutional