Architecture for Latency Reduction
in Healthcare Internet-of-Things
Using Reinforcement Learning and Fuzzy
Based Fog Computing
Saurabh Shukla
1(&)
, Mohd Fadzil Hassan
1
, Low Tan Jung
1
,
and Azlan Awang
2
1
Department of Computer and Information Sciences,
Universiti Teknologi PETRONAS,
32610 Seri Iskandar, Perak Darul Ridzuan, Malaysia
saurabhshkl.shukla@gmail.com,
{mfadzil_hassan,lowtanjung}@utp.edu.my
2
Department of Electrical and Electronic Engineering,
Universiti Teknologi PETRONAS,
32610 Seri Iskandar, Perak Darul Ridzuan, Malaysia
azlanawang@utp.edu.my
Abstract. Internet-of-Things (IoT) generate large data that is processed, anal-
ysed and filtered by cloud data centres. IoT is getting tremendously popular: the
number of IoT devices worldwide is expected to reach 50.1 billion by 2020 and
from this, 30.7% of IoT devices will be made available in Healthcare. Trans-
mission and analysis of this much amount of data will increase the response time
of cloud computing. The increase in response time will lead to high service
latency to the end-users. The main requirement of IoT is to have low latency to
transfer the data in real-time. Cloud cannot fulfill the QoS requirement in a
satisfactory manner. Both the volume of data as well as factors related to internet
connectivity may lead to high network latency in analyzing and acting upon the
data. The propose research work introduces a hybrid approach that combines
fuzzy and reinforcement learning to improve service and network latency in
healthcare IoT and cloud. This hybrid approach integrates healthcare IoT
devices with the cloud and uses fog services with Fuzzy Reinforcement
Learning Data Packet Allocation (FRLDPA) algorithm. The propose algorithm
performs batch workloads on IoT data to minimize latency and manages the
QoS of the latency-critical workloads. It has the potential to automate the rea-
soning and decision making capability in fog computing nodes.
Keywords: Internet-of-Things Á Fog computing Á Cloud computing
Reinforcement learning Á Fuzzy inference system
© Springer Nature Switzerland AG 2019
F. Saeed et al. (Eds.): IRICT 2018, AISC 843, pp. 372–383, 2019.
https://doi.org/10.1007/978-3-319-99007-1_36