Multimodal Sentiment Analysis of Nursery Rhymes for Behavior Improvement of Children Makarand Velankar 1* , Vaibhav Khatavkar 2 , Dr. Parag Kulkarni 3 1* Assistant Professor, MKSSS Cummins College of Engineering Pune, 411052. And Ph.D. Research Scholar PICT, Pune Maharashtra, India. 2 Ph.D. Research Scholar College of Engineering Pune, Maharashtra, India. 3 CEO and Chief Scientist at Kvinna Limited, Pune, Maharashtra, India. Abstract: Introvert children have behavioral issues such as self-centric, poor communication, low confidence, less participation and physically weak, whereas hyperactive children have issues related to non-obedient, aggression, lack of patience, lower concentration levels, and disturbance to others. There is a need to do some remedial measures to improve the behavior of children for their better future. Music interactions with the specific sentiment, i.e. positive sentiments for introvert and negative sentiments for hyperactive children are a proposed approach used. Multimodal analysis of 50 nursery rhymes using cognitive music models with analysis of lyrics and acoustic parameters was performed to select rhymes in specific categories. Specific sets of rhymes were repeatedly played and the behavior was observed and noted for specific predefined parameters by teachers and parents. The improvement noticed in the initial 3 months with about 10 musical sessions per month was in the range of 20 to 40 %. This is probably the first kind of study to use multimodal music sentiment analysis for the behavioral improvement of kids with hyperactive and introvert characteristics. The study also provides effective use of selected acoustic and text features with a normalization approach for sentiment analysis. Keywords: Multimodal sentiment analysis; Music interactions; children’s Behavior improvement; nursery rhymes. 1. Introduction According to renowned psychologists like Sigmund Freud [1], childhood has a profound effect on the development of human psychology. Similar observations were noted by many researchers related to children [2-3]. The childhood experience is built by extracting information from the environment with the preliminary senses, such as touch, smell, vision, taste, and hearing. Child psychologists observing behavior and issues of children at an early age have come up with the terms as hyperactive and introvert to represent specific behavior among children. The problem observed about a hyperactive child full of energy is to showcase the abilities like to dominate others, tend to perform activities that are at times dangerous to them and others, etc. An introvert child with fewer reactions to the external world has issues related to the expression of emotions, quiet, and no or less participation in sports and other activities, etc. The problem of specific children having an age group about 3 to 4 years was mentioned by the school teacher teaching at the nursery level during one informal get-together. According to the observations by the teacher, some children were hyperactive Journal of University of Shanghai for Science and Technology ISSN: 1007-6735 Volume 22, Issue 12, December - 2020 Page-17