C. Stephanidis and M. Antona (Eds.): UAHCI/HCII 2014, Part I, LNCS 8513, pp. 369–378, 2014. © Springer International Publishing Switzerland 2014 A Universal Assistive Technology with Multimodal Input and Multimedia Output Interfaces Alexey Karpov 1,2 and Andrey Ronzhin 2 1 University ITMO, St. Petersburg, Russia 2 St. Petersburg Institute for Informatics and Automation of RAS (SPIIRAS), Russia {karpov,ronzhin}@iias.spb.su Abstract. In this paper, we present a universal assistive technology with multi- modal input and multimedia output interfaces. The conceptual model and the software-hardware architecture with levels and components of the universal as- sistive technology are described. The architecture includes five main intercon- nected levels: computer hardware, system software, application software of digital signal processing, application software of human-computer interfac- es, software of assistive information technologies. The universal assistive tech- nology proposes several multimodal systems and interfaces to the people with disabilities: audio-visual Russian speech recognition system (AVSR), “Talking head” synthesis system (text-to-audiovisual speech), “Signing avatar” synthesis system (sign language visual synthesis), ICANDO multimodal system (hands- free PC control system), and the control system of an assistive smart space. Keywords: Assistive Technology, Multimodal User Interfaces, Multimedia, Universal Access, Audio-Visual Speech, Assistive Applications. 1 Introduction A lot of people around the world are limited in their possibilities because of hearing, vision, speech, motion dysfunctions and mental impairments. For the help, support and rehabilitation of these people there are various governmental programmes in many countries like e-Accessibility, e-Inclusion, Ambient Assisted Living (AAL) [1]. In the last years, Russian government also pays more attention to the problems of life of people with disabilities. In May 2012, the President of Russia has ratified the Convention on the Rights of Persons with Disabilities [2], which was accepted several years ago by the General Assembly of the United Nations. The key points of this Convention state that countries must create conditions for maximal integration of disabled people into the social life on all its levels (including education and informa- tion society). Also, the State Programme “Accessible Environment” [3] intended for 2011-2015 has recently started in Russia. This program supports adaptation of work of governmental, educational, social organizations and information services (includ- ing electronic services) for needs of persons with disabilities, as well as provision of information accessibility and computer means for disabled people, creation and em- bedding of new means of interaction and development of new goods and services that