Responsive and Open Learning Environments (ROLE): Requirements, Evaluation and Reflection Effie Lai-Chong Law 1 , Hans-Christian Schmitz 2 , Martin Wolpers 2 , Ralf Klamma 3 , Marcel Bertold 4 , Dietrich Albert 4 1 Department of Computer Science, University of Leicester, LE1 7RH Leicester, UK, 2 Fraunhofer FIT, Schloss Birlinghoven,53754 Sankt Augustin, Germany 3 Informatik 5, RWTH Aachen,Ahornstr.55, D-52056 Aachen, Germany 4 Knowledge Management Institution, TU Graz, Inffeldgasse 21a/II, 8010 Graz, Austria Abstract. Coordinating requirements engineering (RE) and evaluation studies across heterogeneous technology-enhanced learning (TEL) environments is deemed challenging, because each of them is situated in a specific organizational, technical and socio-cultural context. We have dealt with such challenges in the project of ROLE (http://www.role-project.eu/) in which five test-beds are involved in deploying and evaluating Personal Learning Environments (PLEs). They include Higher Education Institutions (HEIs) and global enterprises in and beyond Europe, representing a range of values and assumptions. While the diversity provides fertile grounds for validating our research ideas, it poses many challenges for conducting comparison studies. In the paper, we first provide an overview of the ROLE project, focusing on its missions and aims. Next we present a Web2.0-inspired RE approach called Social Requirements Engineering (SRE). Then we depict our initial attempts to evaluate the ROLE framework and report some preliminary findings. One major outcome is that the technology adoption process must work on the basis of existing LMS, extending them with the ROLE functionality rather than embracing LMS functionality in ROLE. Keywords: Responsive and open learning environment, Social requirements engineering, Web 2.0, Technology acceptance model, Usability, Evaluation 1 Introduction A well recognized phenomenon in the field of Human-Computer Interaction (HCI) is that technological artefacts, users and social contexts they constitute co-evolve at a rapid and somewhat unpredictable manner ([5], [12]). An alternative approach to capturing user requirements on an ongoing basis has been called for and led to the emergence of Social Requirements Engineering (SRE) approach. Grounded in Actor Network Theory [14] and Community of Practice (CoP; [26]), a distinct feature of SRE is to engage all potential stakeholders from the very early phase of a system development lifecycle. Interaction Design and Architecture(s) Journal - IxD&A, N. 15, 2012, pp. 87-101