Workshop on Test Methods and Metrics for Accessible HRI
Jeremy Marvel
Shelly Bagchi
Megan Zimmerman
Murat Aksu
Brian Antonishek
Jennifer Case
U.S. National Institute of Standards
and Technology
United States
Terry Fong
U.S. National Aeronautics and Space
Administration
United States
Vinh Nguyen
Michigan Technical University
United States
Adam Norton
University of Massachusetts, Lowell
United States
Emmanuel Senft
Idiap Research Institute
Switzerland
Yue Wang
Clemson University
United States
ABSTRACT
As robots become more ubiquitous in our modern world, the expec-
tation that humans and robots will interact physically, conceptually,
and emotionally in everyday life necessitates the development of
validated technologies that are safe, secure, and efective. Regard-
less, robotics is still considered by many as being inaccessible, even
as their availability increases. In alignment with the 2023 HRI Con-
ference’s theme of łHRI for all,ž this ffth installment of the Work-
shop on Test Methods and Metrics for Efective HRI is focused on
addressing this accessibility disparity. Specifcally, this year’s work-
shop presents and addresses issues regarding 1) human factors for
diverse populations, 2) accessibility of standards and specifcations,
and 3) enabling equal and equitable access to research results &
data. The goal of this workshop is to enable increased accessibility
to HRI research and resources by addressing the metrology that is
used to verify and validate HRI performance.
CCS CONCEPTS
· Human-centered computing → Accessibility design and
evaluation methods; Interaction design theory, concepts and
paradigms; Collaborative and social computing design and
evaluation methods; HCI design and evaluation methods.
KEYWORDS
Test methods and metrics, accessibility, repeatability studies, per-
formance measures, benchmarking, data sets
ACM Reference Format:
Jeremy Marvel, Shelly Bagchi, Megan Zimmerman, Murat Aksu, Brian
Antonishek, Jennifer Case, Terry Fong, Vinh Nguyen, Adam Norton, Em-
manuel Senft, and Yue Wang. 2023. Workshop on Test Methods and Met-
rics for Accessible HRI. In Companion of the 2023 ACM/IEEE International
Permission to make digital or hard copies of part or all of this work for personal or
classroom use is granted without fee provided that copies are not made or distributed
for proft or commercial advantage and that copies bear this notice and the full citation
on the frst page. Copyrights for third-party components of this work must be honored.
For all other uses, contact the owner/author(s).
HRI ’23 Companion, March 13–16, 2023, Stockholm, Sweden
© 2023 Copyright held by the owner/author(s).
ACM ISBN 978-1-4503-8290-8/21/03.
https://doi.org/10.1145/3434074.3444880
Conference on Human-Robot Interaction (HRI ’23 Companion), March 13–
16, 2023, Stockholm, Sweden. ACM, New York, NY, USA, 3 pages. https:
//doi.org/10.1145/3434074.3444880
1 ORGANIZING COMMITTEE
Organizers and committee members will recruit and coordinate
reviewers for author-submitted contributions. A website has been
published at https://HRI-methods-metrics.github.io/ to act as an
archive of former workshops and current schedules. For more up-
to-date information, including confrmed speakers, please visit the
webpage. A list of the organizers for 2023 follows.
Dr. Jeremy A. Marvel Dr. Marvel is a research scientist at
NIST. He leads scientists and engineers in metrology eforts at NIST
toward measuring human-robot interaction (HRI) performance, and
developing tools to enable enterprises to efectively deploy robot
solutions. He currently chairs the IEEE P3107 standards working
group, łStandard Terminology for Human-Robot Interaction.ž
Shelly Bagchi Shelly has been a researcher at NIST since 2016.
Her focus is on HRI, particularly evaluating new interface tech-
nologies (e.g., Augmented Reality and wearable devices) for HRI
in manufacturing. She currently chairs the IEEE P3108 Standards
Group, łRecommended Practice for Human-Robot Interaction De-
sign of Human Subject Studies".
Megan Zimmerman Megan has been a computer science re-
searcher at NIST since 2016, and has been involved in the HRI
community since 2015. Megan’s primary area of expertise is in
human-robot interaction and alternative robot control interfaces.
Currently, she is leading eforts at NIST to generate public datasets
for human robot interaction research.
Murat Aksu, Murat has been a researcher at NIST since 2016,
and his principal research interests are in HRI and computer mod-
eling, & simulation of digital twins.
Brian Antonishek Brian is a computer scientist whose research
over the past 20+ years at NIST has focused on user interfaces, HRI,
and three-dimensional (3D) data visualizations.
Dr. Jennifer Case Dr. Case has been a postdoctoral research as-
sociate at NIST since 2019. Her expertise is in soft robotics, ranging
from sensor development to system integration to sensor-enabled
control of soft structures.
944