Permission to make digital or hard copies of all or part of this work for
personal or classroom use is granted without fee provided that copies are not
made or distributed for profit or commercial advantage and that copies bear
this notice and the full citation on the first page. Copyrights for components
of this work owned by others than ACM must be honored. Abstracting with
credit is permitted. To copy otherwise, or republish, to post on servers or to
redistribute to lists, requires prior specific permission and/or a fee. Request
permissions from permissions@acm.org.
MMSys '22, June 14–17, 2022, Athlone, Ireland
© 2022 Association for Computing Machinery.
ACM ISBN 978-1-4503-9283-9/22/06…$15.00
https://doi.org/10.1145/3524273.3532901
Teleoperation of the Industrial Robot: Augmented reality
application
Chung Xue Er (Shamaine)
Department of Computer &
Software Engineering
The Technological University of
the Shannon: Midlands Midwest
Athlone, Ireland
xechung@research.ait.ie
John Henry
Robotics and Drives
Mullingar Business Park,
Mullingar, Ireland
jhenry@rdservices.ie
Yuansong Qiao
Department of Computer &
Software Engineering
The Technological University of
the Shannon: Midlands Midwest
Athlone, Ireland
ysqiao@research.ait.ie
Ken McNevin
Robotics and Drives
Mullingar Business Park,
Mullingar, Ireland
ken@rdservices.ie
Vladimir Kuts
†
Department of Computer &
Software Engineering
The Technological University of
the Shannon: Midlands Midwest
Athlone, Ireland
vkuts@ait.ie
Niall Murray
Department of Computer &
Software Engineering
The Technological University of
the Shannon: Midlands Midwest
Athlone, Ireland
nmurray@research.ait.ie
ABSTRACT
Industry 4.0 is aimed at the full manufacturing domain
automatization and digitalization. Humans and robots working
together are being discussed widely both in the academic and
industrial sectors. As being discussed, there is a need for a more
novel type of interaction method between humans and robots.
This demonstrational paper is presenting the technical
advancement and prototype of remote control and re-
programming of the Industrial robot. This development is safe and
efficient and allows the operator to focus rather on the final task
than the programming process.
CCS CONCEPTS
• Human-centered computing • Human-computer interaction
(HCI) • Interactive systems and tools • User interface management
systems
KEYWORDS
Augmented Reality, Human-Robot Interaction, Industrial Robot
ACM Reference format:
Chung Xue Er Shamaine, Yuansong Qiao, Vladimir Kuts, John Henry, Ken
McNevin and Niall Murray. 2022. Teleoperation of the Industrial Robot:
Augmented reality application. In Proceedings of ACM MMSys conference
(MMSys2022). ACM, Athlone, Ireland, 5 pages.
1 Introduction
The fourth industrial revolution often referred to as Industry 4.0, is
a general term for a new industrial model [1]. Industry 4.0 aims at
building cyber-physical production systems (CPPS) (which
comprise intelligent, real-time-capable, networked sensors and
actuators) that unite both digital and physical worlds to make
manufacturing increasingly smart by utilising the internet of things
(IoT)[1][2]. Industry 4.0 [3] includes a range of digital technologies
that includes but is not limited to Augmented Reality (AR), Virtual
Reality (VR), Digital Twins (DT), predictive maintenance, cloud
computing, Internet of Things (IoT), Artificial Intelligence (AI),
and big data. This stack is essential in achieving smart factories of
the future (FoF).
However, little research has been conducted to develop a user-
centred human-robot interaction (HRI) in the context of industry
4.0 environment requirements. HRI is the study of how humans
communicate with robotic systems. It informs us on how to best
design, evaluate, understand and implement robotic systems that
are competent enough for carrying out collaborative tasks with the
human stakeholder [4][5]. One of the major challenges encountered
299