2nd UNITED-SAIG International Conference, 23. May 2022 until 24. May 2022 Page | 1 Immersive Gamified Augmented Reality Application Aided Human-Machine Interaction Nadia Abdul Rani * 1,2 , Faieza Abdul Aziz 1* , Azfanizam, A.S 1 , Abdul Aziz Hairudin 1 , Abdul Rahman Hemdi 3 , Rafiq Johan 1 a Department of Mechanical and Manufacturing Engineering, Faculty of Engineering Universiti Putra Malaysia, 43400 UPM Serdang Selangor,Malaysia b Department of Mechanical Engineering, Politeknik Tuanku Sultanah Bahiyah, Kulim Hi-tech Park, 09000 Kulim, Kedah c Intelligent and Sustainable Manufacturing Center (ISMaC), Faculty of Mechanical Engineering, Universiti Technology MARA, UiTM Pulau Pinang, Jalan Permatang Pauh, 13500 Permatang Pauh, Pulau Pinang, Malaysia *gs53369@student.upm.edu.my , *faieza@upm.edu.my Abstract— Recently, the use of augmented reality (AR) has arisen aligned with the principle of the 4th industrial revolution (IR4.0). The development of Industry 4.0 (I4.0) will be accompanied by changes in tasks and demands for humans in various fields which include manufacturing and automotive industries. Even though the advanced technology allows short working times and the precise repeatability of the processing, machines and equipment need to be controlled and managed by an expert operator. Skilled graduates play the roles in modern (I4.0) manufacturing environments. In this paper, an immersive gamified augmented reality (AR) application has been developed to aid human-machine interaction. The virtual platform consists of images, interactive elements, simulation, and task completion to enhance users’ understanding of the basic operation. The guided technology-based learning was designed on the user interface (UI) for ease of use and user experience (UX) for user usefulness. The results of users’ scores had increased with a percentage of 9.09 % to 70% improvement with two attempts of the application. As a conclusion, the augmented reality (AR) application via gamification supports and enhances the psychomotor phase in human skills development as well as a tool of cybergogy learning concept with virtual application technology. Keywords— Augmented Reality, Gamification, Human- machine interaction , Cybergogy I. INTRODUCTION The growing need and initiative to reduce operating costs of production capacities, human resources, and errors in component production have led to the growth of manufacturing automation and higher demand for the latest technology of machining industry. Currently CNC machines are widely used in various industries and fields and it is important for modern standards of industrial manufacturing [1]. CNC machines can perform multiple operations unlike conventional machine tools, which require changing of tools after every operation adding to the cycle time. [2] justified that CNC machines are high complexity machines, especially for beginners; with low ergonomics since the operator has to move continuously between the machine window and a control screen to ensure smooth operations. [3] defined two different types of CNC machines in the market and commonly used are 2-axis and 3-axis CNC machines. The CNC machine consists of three elements, human, machine, and controller. The controller plays the role of the interaction element between humans and machines. For many operators, the CNC machine control panel poses a heavy burden because it is not easy to use [4]. This is because the poor design of the HMI scheme doesn’t conform to the user’s mental model [5]. A. Human-machine Interaction The Human-Machine Interaction (HMI) as referred to [6] is the communication and interaction between a human and a machine via a user interface.is the communication by the user. The HMI of the CNC machine controller affects the operational efficiency and experience of users. The operator can control the CNC machine system using the control panel display to achieve mechanical parts processing, cutting, and other operations. The controller mainly includes the total control area, pattern selection area, spindle control area, program edit area, and tool changer area. [7] critically issued CNC interfaces, from the point of view of human-machine interaction and summarised as: not suitable support information, the alternation between panel and machine, non-homogeneity of presented information, and user’s tasks not focusing on production functions. B. Augmented Reality Application The impact of Industry 4.0 on workforce recruitment is expected to be significant since the requirements of the skill needs will be changed. AR has become one of the pillar elements to revolute the IR4.0 realization. The industry will demand skilled candidates to work in this new era of industrial 4.0. The human workforce was integrated into the manufacturing systems and must be flexible and adaptive [8]. A good digital learning platform should be able to completely record learners’ learning