MOBILTEL - Mobile Multimodal Telecommunications dialogue system based on VoIP telephony Anton Čižmár, Matúš Pleva, Ján Papaj, Ľubomír Doboš, Jozef Juhár Dept. of Electronics and Multimedia Communications, Technical University of Košice, Letná 9, 042 00 Košice, Slovak Republic, Email: Anton.Cizmar@tuke.sk, Matus.Pleva@tuke.sk, Jan.Papaj@tuke.sk, Lubomir.Dobos@tuke.sk, Jozef.Juhar@tuke.sk Abstract – In this paper the project MobilTel is presented. The communication itself is becoming a multimodal interactive process. The MobilTel project provides research and development activities in multimodal interfaces area. The result is a functional architecture for mobile multimodal telecommunication system running on handheld device. The MobilTel communicator is a multimodal Slovak speech and graphical interface with integrated VoIP client. The other possible modalities are pen – touch screen interaction, keyboard, and display on which the information is more user friendly presented (icons, emoticons, etc.), and provides hyperlink and scrolling menu availability. We describe the method of interaction between mobile terminal (PDA) and MobilTel multimodal PC communicator over a VoIP WLAN connection based on SIP protocol. We also present the graphical examples of services that enable users to obtain information about weather or information about train connection between two train stations. Keywords: multimodal services, PDA, voice over IP, speech recognition. I. INTRODUCTION The main goal of this project is the research and development in the area of mobile multimodal telecommunication systems, which allows access to information from different areas through mobile multimodal terminal and human - machine interaction with natural speech, with support of another - mainly graphical - modalities. The solution of the project is furthermore the goal of information exchange and acquisition of new knowledge from the area of the research, development and use of mobile telecommunication systems and services, automatic speech recognition, speech synthesis, automatic speech and multimodal dialog systems, network programming, voice over IP protocols, and other subjects according to the solving of the point of this project. MobilTel Communicator enables multimodal multi- user interaction in Slovak language through telecommunication or IP network to find information in databases or Internet websites. The speech, graphical user interface, pen and keyboard on PDA device are on of the possible and also available modalities. Fig. 1. MobilTel Communicator architecture 134