INTL. JOURNAL OF HUMAN–COMPUTER INTERACTION, 25(7), 692–706, 2009
Copyright © Taylor & Francis Group, LLC
ISSN: 1044-7318 print / 1532-7590 online
DOI: 10.1080/10447310902964132
HIHC 1044-7318 1532-7590 Intl. Journal of Human–Computer Interaction, Vol. 25, No. 6, Jun 2009: pp. 0–0 Intl. Journal of Human–Computer Interaction
Nomadic Speech-Based Text Entry: A Decision
Model Strategy for Improved Speech
to Text Processing
Nomadic Speech-Based Text Entry Price et al.
Kathleen J. Price
1
, Min Lin
1
, Jinjuan Feng
1
, Rich Goldman
1
,
Andrew Sears
1
, and Julie Jacko
2
1
Interactive Systems Research Center, UMBC, Baltimore, MD
2
Georgia Institute of Technology, Atlanta
Speech text entry can be problematic during ideal dictation conditions, but difficul-
ties are magnified when external conditions deteriorate. Motion during speech is an
extraordinary condition that might have detrimental effects on automatic speech
recognition. This research examined speech text entry while mobile. Speech enroll-
ment profiles were created by participants in both a seated and walking environ-
ment. Dictation tasks were also completed in both the seated and walking
conditions. Although results from an earlier study suggested that completing the
enrollment process under more challenging conditions may lead to improved recog-
nition accuracy under both challenging and less challenging conditions, the current
study provided contradictory results. A detailed review of error rates confirmed that
some participants minimized errors by enrolling under more challenging conditions
while others benefited by enrolling under less challenging conditions. Still others
minimized errors when different enrollment models were used under the opposing
condition. Leveraging these insights, we developed a decision model to minimize
recognition error rates regardless of the conditions experienced while completing
dictation tasks. When applying the model to existing data, error rates were reduced
significantly but additional research is necessary to effectively validate the proposed
solution.
1. INTRODUCTION
Mobile data entry presents a design conundrum for systems analysts and devel-
opers. Users require interaction methods that are accurate, quick, and easy to use,
but accomplishing these goals can be difficult when you consider the additional
challenges associated with mobile handheld computing devices. The small size of
This material is based on work supported by the National Science Foundation (NSF) under Grant
Nos. IIS-0121570 and IIS-0328391. Any opinions, findings and conclusions or recommendations
expressed in this material are those of the authors and do not necessarily reflect the views of the NSF.
Correspondence should be addressed to Andrew Sears, UMBC, Information Systems Department,
1000 Hilltop Circle, Baltimore MD 21250. E-mail: asears@umbc.edu