Ontology-Driven Automation of IoT-Based Human-Machine Interfaces Development ⋆ Konstantin Ryabinin 1[0000-0002-8353-7641] , Svetlana Chuprina 1[0000-0002-2103-3771] , and Konstantin Belousov 1[0000-0003-4447-1288] Perm State University, Bukireva Str. 15, 614990, Perm, Russia kostya.ryabinin@gmail.com, chuprinas@inbox.ru, belousovki@gmail.com Abstract. The paper is devoted to the development of high-level tools to automate tangible human-machine interfaces creation bringing to- gether IoT technologies and ontology engineering methods. We propose using ontology-driven approach to enable automatic generation of firmware for the devices and middleware for the applications to design from scratch or transform the existing M2M ecosystem with respect to new human needs and, if necessary, to transform M2M systems into human-centric ones. Thanks to our previous research, we developed the firmware and middleware generator on top of SciVi scientific visualization system that was proven to be a handy tool to integrate different data sources, in- cluding software solvers and hardware data providers, for monitoring and steering purposes. The high-level graphical user SciVi interface en- ables to design human-machine communication in terms of data flow and ontological specifications. Thereby the SciVi platform capabilities are sufficient to automatically generate all the necessary components for IoT ecosystem software. We tested our approach tackling the real-world problems of creating hardware device turning human gestures into se- mantics of spatiotemporal deixis, which relates to the verbal behavior of people having different psychological types. The device firmware gener- ated by means of SciVi tools enables researchers to understand complex matters and helps them analyze the linguistic behavior of users of so- cial networks with different psychological characteristics, and identify patterns inherent in their communication in social networks. Keywords: Ontology Engineering · Internet of Things · Human-Machine Interaction · Tangible Interfaces · Firmware · Middleware · Scientific Vi- sualization · Visual Analytics. 1 Introduction Universal computer input devices like keyboard and mouse build the habitual en- vironment for user and normally suit everyday needs in terms of human-machine ⋆ The reported study is supported by Ministry of Education and Science of the Russian Federation, State Assignment No. 34.1505.2017/4.6 (Research Project of Perm State University, 2017–2019). ICCS Camera Ready Version 2019 To cite this paper please use the final published version: DOI: 10.1007/978-3-030-22750-0_9