C. Stephanidis and M. Antona (Eds.): UAHCI/HCII 2014, Part IV, LNCS 8516, pp. 358–367, 2014. © Springer International Publishing Switzerland 2014 Evaluating the Global Public Inclusive Infrastructure: Cloud4all Evaluation Framework Eleni Chalkia 1 , Juan Bautista Montalva Colomer 2 , Silvia de los Rios 2 , and Ivan Carmona Rojo 3 1 Centre of Research and Technology Hellas/Hellenic Institute of Transport (CERTH/HIT), Thessaloniki, Greece hchalkia@certh.gr 2 Universidad Politécnica de Madrid (UPM), Madrid, Spain {jmontalva,srios}@lst.tfo.upm.es 3 Technosite - Fundación ONCE, Madrid, Spain icarmona@technosite.es Abstract. Moving rapidly into digital economy expands the need for accessibil- ity coming from the growing number of people with disabilities, in various con- texts. Additionally, ubiquitous computing has amplified the need for interactive systems to be able to adapt to their context of use, enhancing their utility while preserving usability. Cloud4all project [0] aims to develop a complete new paradigm in accessibility, by replacing adaptation of individual products and services, with auto-configuration of any mainstream product or service, using cloud technologies to activate and augment any natural accessibility the product or service has, based upon a set of the user’s Needs & Preferences (N&Ps). In order to assess this goal, Cloud4all has developed an evaluation framework, as part of the User Centred Design (UCD) iterative process. This paper provides an overview of the 1 st pilots’ evaluation framework, together with ideas and plans about the general framework of the pilot test. Keywords: Accessibility, evaluation framework, auto-configuration, scenario, usability, user experience, Cloud4all. 1 Introduction In order to be useful, ubiquitous systems need to be designed following user centered design, so that the users’ Needs & Preferences (N&Ps) are taken into account in the entire design and development process [2]. The goal of this user centered design (UCD) is to create tools and products that satisfy the user who is willing to use them due to their increased utility, ease of use, and pleasure provided by the interaction with them. However, the evaluation of pervasive computing systems and their influ- ences on users is quite difficult because it requires analysis of real users in a real con- text [3]. User centered design is enhanced by the involvement of real users in a real context, doing multiple evaluations of the products under development during the development