International Journal of Current Engineering and Technology
©2021 INPRESSCO
®
, All Rights Reserved Available at http://inpressco.com/category/ijcet
Review Article
617| International Journal of Current Engineering and Technology, Vol.11, No.6 (Nov/Dec 2021)
Gestures Controlled Home Automation using Deep Learning: A Review
A. D. Harale
1
, Amruta S. Bankar
2*
and K. J. Karande
3
1,2,3
Department of Electronics and Telecommunication Engineering, SKN Sinhgad College of Engineering, Korti, Pandharpur, Taluka-Pandharpur,
District-Solapur, Pin-413 304, Maharashtra, India.
Received 15 Oct 2021, Accepted 10 Nov 2021, Available online 16 Nov 2021, Vol.11, No.6 (Nov/Dec 2021)
Abstract
This paper presents the review of the studies carried out on the application using computer vision for hand gesture
recognition. Hand gestures can be used to operate the electronic devices. Therefore, it is very much essential to review
on the scientific studies whose aim is to develop a technique to achieve more precise and faster sign language
recognition system for plain and cluttered backgrounds with different humans to help speech and hearing impaired in
their life, robot control, human–computer interaction (HCI), home automation and medical fields. The objective of this
paper is to give an overall literature review of the work done related to identify the current technology and
methodology used in hand gesture recognition as well as home automation system. This paper mainly describes various
images or vision based sign language recognition system comprising pre-processing, feature extraction and
classification. The system conversion of sign language to text. The recognized text can be sent to the control model. The
gesture based automation communicates directly with control model to control home appliances.
Keywords: Gesture Recognition, Image Classification, Deep Learning, Home Appliances
1. Introduction
Now a day, the scope for hand gestures has been
increased for interaction with consumer electronics and
mobile devices. The objective of the home automation
system is to create a system that can manage home
appliances using any one of the two assigned methods:
1. Gesture-based 2. Web-based.
Disabled or old aged people who can't walk require an
effortless way of accessing things around them, which
must be served systematically and efficiently. This idea
integrates automation with technology. Traditional
home automation systems are not suitable for aging
populations or disable persons. It’s for those who
cannot perform basic activities efficiently. Home
automation systems are used to control home
appliances through remote control. Web-based
automation and gesture-based automation provides a
comfort to those people who are physically unable for
efficiently performing the day-to-day tasks.
Home automation or domestics is building
automation for a home, called a smart home or smart
house. A home automation system will control lighting,
climate, entertainment systems, and appliances.
*Corresponding author’s ORCID ID: 0000-0003-2096-9524
DOI: https://doi.org/10.14741/ijcet/v.11.6.4
It may also include home security such as access control
and alarm systems. When connected with the Internet,
Home devices are an important constituent of the
Internet of Things. Hand Gesture Recognition System is
a branch of Human Computer Interaction in which
Human hand gestures are recognized by the computer
system and then perform a pre-defined task as per the
application for controlling software as well as
hardware. As we know, the vision-based technology of
hand gesture recognition is an important part of human-
computer interaction (HCI). In the last decades,
keyboard and mouse play a significant role in human
computer interaction. However, owing to the rapid
development of hardware and software, new types of
HCI methods have been required. In particular,
technologies such as speech recognition and gesture
recognition receive great attention in the field of HCI.
Being able to interact with the system naturally is
becoming ever more important in many fields of Human
Computer Interaction.
Hand gestures offer an inspiring field of research
because they can facilitate communication and provide
a natural means of interaction that can be used across a
variety of applications. Previously, hand gesture
recognition was achieved with wearable sensors
attached directly to the hand with gloves. These sensors
detected a physical response according to hand
movements or finger bending. The data collected were
then processed using a computer connected to the glove
with wire. This system of glove-based sensor could be