OSMoSIS: Interactive Sound Generation
System for Children with Autism
Abstract
This paper reports on the design and pilot evaluation of
a system that uses movement, music and sounds to
support playful interactions for children with Autism
Spectrum Conditions (ASC). OSMoSIS (Observation of
Social Motor Synchrony with an Interactive System) is a
musical motion-based game. The design was inspired by
previous research that suggests that music and
movement can be helpful in fostering communication
and expression skills, and the first author’s experiences
as a music therapist. OSMoSIS converts movements into
sounds, using a Microsoft Kinect-based system which
provides full body tracking. A recently conducted
evaluation with a group of 11 children with autism aged
5– 11 years old showed positive engagement with the
system, and some instances of imaginative play. In our
discussion, we highlight implications for the design of
future music and movement systems to support learning
in children with autism.
Author Keywords
Autism; movement; music; motion based touchless
interaction; data analysis; log data; interaction.
CSS Concepts
• Human-centered computing: Human~computer
interaction (HCI)~Interaction techniques~Gestural
Grazia Ragone
University of Sussex
Brighton, UK
G.Ragone@sussex.ac.uk
Katherine Howland
University of Sussex
Brighton, UK
K.L.Howland@sussex.ac.uk
Judith Good
University of Sussex
Brighton, UK
J.Good@sussex.ac.uk
Permission to make digital or hard copies of part or all of this work for
personal or classroom use is granted without fee provided that copies are
not made or distributed for profit or commercial advantage and that copies
bear this notice and the full citation on the first page. Copyrights for third-
party components of this work must be honored. For all other uses, contact
the owner/author(s).
IDC 2020 Extended Abstracts, June 21–24, 2020, London, United Kingdom.
© 2020 Copyright is held by the owner/author(s).
ACM ISBN 978-1-4503-8020-1/20/06.
DOI: https://doi.org/10.1145/3397617.3397838