PAPER DESIGN OF HEAD MOVEMENT CONTROLLER SYSTEM (HEMOCS) FOR CONTROL MOBILE APPLICATION THROUGH … Design of Head Movement Controller System (HEMOCS) for Control Mobile Application through Head Pose Movement Detection http://dx.doi.org/10.3991/ijim.v10i3.5552 Herman Tolle 1 and Kohei Arai 2 1 Brawijaya University, Malang, Indonesia 2 Saga University, Sagashi, Japan Abstract—Head movement has been found to be a natural way of interaction. It can be used as an alternative control method and provides accessibility for users when used in human computer interface solutions. The combination of Head-mounted displays (HMDs) with mobile devices, pro- vide an innovation of new low cost of human-computer interaction. Such devices are hands-free systems. In this paper, we introduce a new method for recognizing head movement as the controller of mobile application and pro- posed a new control system using head movement only. The proposed method can determine specific head pose move- ment and respond it as a controller of an application. The implementation of a music player application on an iOS devices shows that the proposed method is appropriate for a new experience of real-time human-computer interaction with head movement control only. Index Terms—head mounted display, accelerometer, head motion estimation, human computer interaction. I. INTRODUCTION Head movement detection has received significant at- tention in recent research. One of the specific purposes for head movement detection and tracking is to allow the user to interact with a computer or new devices like mobile phone. The increased popularity of the wide range of applications of which head movement detection is a part, such as assistive technology, virtual reality, and augment- ed reality, have increased the size of research aiming to provide robust and effective techniques of real-time head movement detection and tracking [1]. There are many different approaches for head move- ment estimation. All investigated methods require high computational and still difficult to implemented using low computational hardware. Recently, there are three popular approaches for estimating head movement and tracking: using camera based image processing, sensor based meth- od using accelerometer and gyroscope, and the combina- tion of different techniques. Most of the head pose estimation method is based on computer vision approach, like [2][3][4]. Liu et al. [2] introduced a video-based technique for estimating the head pose and used it in an image processing application for a real-world problem; and attention recognition for drivers. Murphy-Chutorian and Trivedi [3] presented a static head pose estimation algorithm and a visual 3-D tracking algorithm based on image processing and pattern recognition. Kupetz et al. [4] implemented a head move- ment tracking system using an IR camera and IR LEDs. Another approach for head movement detection is by using sensors such as gyroscopes and accelerometers. King et al. [5] implemented a hands-free head movement classification system which uses pattern recognition tech- niques with mathematical solutions for enhancement. A dual axis accelerometer mounted inside a hat was used to collect head movement data. A similar method was pre- sented by Nguyen et al. [6]. The method detects the movement of a user's head by analyzing data collected from a dual-axis accelerometer and pattern recognition techniques. But still no application based on the proposed method was suggested. Other sensor based approach like [7][8]. However, it needs more theoretical proofs and more experiments and accuracy analysis. A combination of different techniques can be used in head tracking systems. Satoh et al. [9] proposed a head tracking method that uses a gyroscope mounted on a head- mounted device (HMD) and a fixed bird's-eye view cam- era responsible for observing the HMD from a third- person viewpoint. Using a fixed camera, customized marker, gyroscope sensor and calibration process makes this proposal impractical for head tracking tasks. The time complexity of the algorithm has not been investigated which makes it a little far from being used in real-world applications. Head-mounted displays (HMDs) embedded in eye- glasses are the next innovation along the path of commu- nication techniques. Such devices are hands-free systems. Although this is not a new idea, currently released and commercially available products (such as the Project Glass by Google) show the immense potential of this technology. They function as stand-alone computers; their light glass frame is equipped with a variety of sensors; a projector displays images and information onto the eye. In our previous research work, we propose head movement detection and tracking as a controller for 3D object scene view [10] and the combination of user’s head and body movement as a controller for virtual reality labyrinth game [11]. In this paper, we introduce a new type of head move- ment controlling systems using 3 degrees of freedom of head rotation movement. The method is based on recog- nizing the internal accelerometer and gyro sensor data inside a mobile phone placed on user's head using Head- mounted Display (HMD) like Google cardboard (called as dummy HMD). A real-time mobile application is built to 24 http://www.i-jim.org