Bimodal Speech Recognition for Robot Applications Alaa Sagheer, Saleh Aly and Samar Anter Abstract By the earliest motivation of building robots to take care of human being in the daily life, the researches on humanoid robots have been explored and developed over the recent decades. One challenge of humanoid robots is its capability of communication with people via audio-visual speech. Cer- tainly, the integration of audio module and visual module improve the robot performance. In this paper, we present a novel system combines these two modules in one environment to be utilized alone or in humanoid robots. The proposed system adapts the user facial movements that cannot be avoided in reality. The experimental results show how these two modules enhance each other and yield an effective speech recognizer. Key words: Human-computer interaction, audio-visual speech recognition, face detection, user identification, lip reading 1 Introduction Recently, due to the increasing demands for the symbiosis between human and robots, humanoid robots (HR) are expected to offer the perceptual capa- Alaa Sagheer Center for Artificial Intelligence and RObotics (CAIRO), Department of of Mathematics, Faculty of Science, Aswan University, Aswan, Egypt, e-mail: alaa@cairo-aswu.edu.eg Saleh Aly Center for Artificial Intelligence and RObotics (CAIRO), Department of Electrical En- gineering, Faculty of Engineering, Aswan University, Aswan, Egypt, e-mail: saleh@ cairo-aswu.edu.eg Samar Anter Center for Artificial Intelligence and RObotics (CAIRO), Aswan University, Aswan, Egypt, e-mail: samar@cairo-aswu.edu.eg 1