Indonesian Journal of Electrical Engineering and Computer Science Vol. 38, No. 2, May 2025, pp. 1061~1072 ISSN: 2502-4752, DOI: 10.11591/ijeecs.v38.i2.pp1061-1072  1061 Journal homepage: http://ijeecs.iaescore.com Intelligent voice control system for UAV with mobile robot Sabyrzhan Atanov, Khuralay Moldamurat, Makhabbat Bakyt, Dariga Zinagabdenova, Aibek Moldamurat, Berik Zhumazhanov, Adil Maidanov Department of Information Security, Faculty of Information Technologies, L. N. Gumilyov Eurasian National University, Astana, Republic of Kazakhstan Article Info ABSTRACT Article history: Received Jun 23, 2024 Revised Nov 4, 2024 Accepted Nov 11, 2024 The article presents a voice control system for unmanned aerial vehicles (UAVs) and an integrated mobile robot, based on artificial intelligence (AI). The system recognizes voice commands in the Kazakh language, converted into Latin transliteration, providing intuitive control of the UAV and robot. The performance of the system in various scenarios including agriculture, environmental monitoring and search and rescue operations is investigated. The system showed high accuracy of command recognition (95%) and efficient control of the UAV and robot. The proposed system opens up new possibilities for the use of UAVs and robots in various fields, increasing their autonomy, flexibility and ease of use. Keywords: Human-robot interaction Intelligent voice control system Mobile robot Natural language processing Speech recognition Unmanned aerial vehicle This is an open access article under the CC BY-SA license. Corresponding Author: Makhabbat Bakyt Department of Information Security, Faculty of Information Technologies L. N. Gumilyov Eurasian National University Astana, Republic of Kazakhstan Email: bakyt.makhabbat@gmail.com 1. INTRODUCTION Modern technological advances in the field of unmanned aerial vehicles (UAVs) and mobile robots open up wide opportunities for their application in various fields, including environmental monitoring, search and rescue operations, agriculture, logistics and many more [1]-[3]. Effective control of these systems is a key factor in the successful completion of assigned tasks and ensuring safety [4]. Traditional control methods based on manual control or pre-programming have a number of limitations related to flexibility and adaptability to dynamically changing environmental conditions [5]. In recent years, there has been increased interest in the use of voice control to interact with UAVs and mobile robots [6]-[8]. This approach offers an intuitive and natural way of interaction, allowing operators to issue commands and receive information through voice [9]. Voice control is especially relevant in situations where the operator’s hands are busy or when quick decision-making and response to changing conditions is required [10]. However, developing intelligent voice control systems for UAVs interacting with mobile robots is a complex task associated with a number of challenges. Ensuring reliable speech recognition in the presence of noise, interference, and other factors typical of real-world operating conditions is one of the key issues [11], [12]. In addition, the system should be able to understand commands in natural language, taking into account various wording, context, and possible ambiguities [13]. It is also important to ensure safe and effective interaction between the UAV, mobile robot, and operator, especially in critical situations that require a high degree of coordination and synchronization of actions [14].