Multimodal Interaction Flow Representation for Ubiquitous Environments - MIF: A Case Study in Surgical Navigation Interface Design Gul Tokdemir 1(&) , Gamze Altun 1 , Nergiz E. Cagiltay 2 , H. Hakan Maras 1 , and Alp Ozgun Borcek 3 1 Computer Engineering Department, Cankaya University, Ankara, Turkey {gtokdemir,hhmaras}@cankaya.edu.tr, c1371205@student.cankaya.edu.tr 2 Software Engineering Department, Atilim University, Ankara, Turkey necagiltay@atilim.edu.tr 3 Department of Neurosurgery, Gazi University, Ankara, Turkey alpborcek@gmail.com Abstract. With the advent of technology, new interaction modalities became available which augmented the system interaction. Even though there are vast amount of applications for the ubiquitous devices like mobile agents, smart glasses and wearable technologies, many of them are hardly preferred by users. The success of those systems is highly dependent on the quality of the inter- action design. Moreover, domain specific applications developed for these ubiquitous devices involve detailed domain knowledge which normally IT professionals do not have, which may involve a substantial lack of quality in the services provided. Hence, effective and high quality domain specific applica- tions developed for these ubiquitous devices require significant collaboration of domain experts and IT professionals during the development process. Accord- ingly, tools to provide common communication medium between domain experts and IT professionals would provide necessary medium for communi- cation. In this study, a new modelling tool for interaction design of ubiquitous devices like mobile agents, wearable devices is proposed which includes dif- ferent interaction modalities. In order to better understand the effectiveness of this newly proposed design tool, an experimental study is conducted with 11 undergraduate students (novices) and 15 graduate students (experienced) of Computer Engineering Department for evaluating defect detection performance for the defects seeded into the interface design of a neuronavigation device. Results show that the defects were realized as more difficult for the novices and their performance was lower compared to experienced ones. Considering the defect types, wrong information and wrong button type of defects were recog- nized as more difficult. The results of this study aimed to provide insights for the system designers to better represent the interaction design details and to improve the communication level of IT professionals and the domain experts. Keywords: Interaction design Á Ubiquitous interfaces Á Diagrammatic reasoning Á Defect detection © Springer International Publishing Switzerland 2015 M. Kurosu (Ed.): Human-Computer Interaction, Part II, HCII 2015, LNCS 9170, pp. 797–805, 2015. DOI: 10.1007/978-3-319-20916-6_73