SketchRec 2023: 3rd Workshop on Sketch Recognition
Paul Taele
ptaele@tamu.edu
Texas A&M University
College Station, Texas, USA
Rachel Blagojevic
R.V.Blagojevic@massey.ac.nz
Massey University
Palmerston North, New Zealand
Tracy Hammond
hammond@tamu.edu
Texas A&M University
College Station, Texas, USA
Samantha Ray
sjr45@tamu.edu
Texas A&M University
College Station, Texas, USA
Josh Cherian
jcherian14@tamu.edu
Texas A&M University
College Station, Texas, USA
Jung In Koh
jungin@tamu.edu
Texas A&M University
College Station, Texas, USA
ABSTRACT
Sketch recognition is the interpretation of hand-drawn diagrams,
and seeks to understand the users’ intent while allowing them
to draw unconstrained diagrams. Research in sketch recognition
has been on-going for approximately half a century, and has ex-
perienced iterative advances due to the difculty of the problem.
As pen- and touch-capable devices such as smartphones, tablets,
touch-driven monitors, and large touchscreen devices have become
ubiquitous, and as emergent technologies such as virtual and aug-
mented reality-driven computing technologies are becoming more
advanced, sketch recognition-related research remains an open feld
for researchers to explore in approaching continuing interaction
and recognition challenges with these technologies. The SketchRec
workshop was hosted at the ACM Annual Conference on Intelligent
User Interfaces (IUI) and served the sketch recognition research
community for sharing, presenting, and discussion research work
that relates to the topics in the research feld.
CCS CONCEPTS
· Human-centered computing → Interaction techniques;·
Applied computing;· Computing methodologies → Machine
learning approaches;
KEYWORDS
sketch recognition, sketch understanding, pen input computing,
document processing, design, intelligent user interfaces
ACM Reference Format:
Paul Taele, Rachel Blagojevic, Tracy Hammond, Samantha Ray, Josh Cherian,
and Jung In Koh. 2023. SketchRec 2023: 3rd Workshop on Sketch Recogni-
tion. In 28th International Conference on Intelligent User Interfaces (IUI ’23
Companion), March 27ś31, 2023, Sydney, NSW, Australia. ACM, New York,
NY, USA, 3 pages. https://doi.org/10.1145/3581754.3584184
1 WORKSHOP DESCRIPTION
Sketch recognition is the interpretation of hand-drawn diagrams,
and seeks to understand the users’ intent while allowing them to
Permission to make digital or hard copies of part or all of this work for personal or
classroom use is granted without fee provided that copies are not made or distributed
for proft or commercial advantage and that copies bear this notice and the full citation
on the frst page. Copyrights for third-party components of this work must be honored.
For all other uses, contact the owner/author(s).
IUI ’23 Companion, March 27ś31, 2023, Sydney, NSW, Australia
© 2023 Copyright held by the owner/author(s).
ACM ISBN 979-8-4007-0107-8/23/03.
https://doi.org/10.1145/3581754.3584184
draw unconstrained diagrams [3]. Research in sketch recognition
has been on-going for approximately half a century, and has ex-
perienced iterative advances due to the difculty of the problem.
The breadth of work related to sketch recognition research encom-
passes diverse algorithms [1, 15, 18], applications [2, 4, 6, 16, 17],
and techniques [3, 10ś12, 14].
As pen- and touch-capable devices such as smartphones, tablets,
touch-driven monitors, and large touchscreen devices have become
ubiquitous, and as emergent technologies such as virtual and aug-
mented reality-driven computing technologies are becoming more
advanced, sketch recognition-related research remains an open feld
for researchers to explore in approaching continuing interaction
and recognition challenges with these technologies. The SketchRec
workshop was hosted at the ACM Annual Conference on Intelligent
User Interfaces (IUI) and served the sketch recognition research
community for sharing, presenting, and discussion research work
that relates to the topics in the research feld.
1.1 Relevance to IUI Conference Theme
The SketchRec workshop strongly relates to the IUI conference’s
themes in its focus on both advancing the intuitiveness of interac-
tive sketching activities and the robustness of sketch recognition
approaches. The workshop’s topic leverages both user experience
research found in the feld of human-computer interaction (HCI)
and machine learning (ML) research found in the feld of artifcial
intelligence (AI).
1.2 Interest to IUI 2023 Audience
The workshop targeted the interest of the IUI 2023 audience as com-
puting technologies related to sketching interactions continue to
be more ubiquitous and familiar. With smartphones, tablets, touch-
capable monitors, and large touchscreen displays become devices
of everyday occurrences, and with emergent devices such as virtual
reality (VR), augmented reality (AR), and tangible-capable inter-
faces growing in adoption, such devices are capable of supporting
touch and pen interactions but have not yet seamlessly emulated
or intelligently supported writing interactions that persist with
pen-and-paper or marker-and-board interactions. These open re-
search challenges provide opportunities for the sketch recognition
community to reduce the gap between conventional and intelligent
sketching interactions.
202