International Journal “Information Theories and Applications”, Vol. 26, Number 2, © 2019
115
MARKER-BASED FINGER GESTURE INTERACTION IN MOBILE
AUGMENTED REALITY
Loubna Ahmed, Doaa Hegazy, Salma Hamdy, Taha Elarif
Abstract: This paper proposes a mobile AR application that allows the user to
perform 2D interactions with the 3D virtual objects. The user is supposed to
hold the mobile with his left hand and interact using the other one. In addition,
the user is supposed to attach two colored markers (stickers) to his fingers; blue
for the thumb and green for the index. User studies (experiments) were
conducted to test the different interaction types; translation, scaling and rotation.
The application run on a Samsung Note 5 device with Android 7 as OS. Our
results were based on the performance (completion) time per each task per
each participant in addition to a subjective questionnaire that was answered by
the participants after finishing the user studies. According to the results, it was
found that this approach had a delay which implies low performance and users
faced a slight difficulty in accomplishing all tasks, yet this approach proved to be
engaging and fun.
Keywords: Mobile Augmented Reality, Marker-based Interaction, Color
Detection.
ITHEA Keywords: H.5 INFORMATION INTERFACES AND PRESENTATION,
H.5.1 Multimedia Information Systems.
Introduction
Over the past years, Augmented Reality (AR) has evolved and one of its
evolutions is mobile AR. A key point of mobile AR is being reactive, which
imposes real-time constraints. Interaction techniques focus on allowing the
users to interact with the emerging virtual object and are considered the basis
for having a successful AR system.