Participatory Refinement of Participatory Outcomes: Students Iterating over the Design of an Interactive Mobile Learning Application Muhammad Mustafa Hassan 1,2 , Adnan N. Qureshi 2 , Andrés Moreno 3 and Markku Tukiainen 1 1 University of Eastern Finland, FI-80101, Joensuu, Finland 2 University of Central Punjab, Lahore-54000, Pakistan 3 United Nations University – Computing and Society, Macau SAR, China Abstract. Significant research efforts have been put in refining concept/require- ments of novel systems innovated by experts or crowds. However, there is scarce evidence of refinement techniques developed for and/or applied to the con- cept/requirements of novel systems innovated with participatory design. Argua- bly, general idea assessment and refinement techniques can be applied to partic- ipatory innovations. But including expert-centered techniques in a pure partici- patory project violates the basic philosophy of user-centeredness. In this work, the authors report on conception and application of a participatory refinement technique applied to refine the outcomes of participatory innovation/design. The reported participatory refinement experiment is performed on the design of a case tool—Jeliot Mobile—innovated earlier through participatory workshops. The au- thors draw several implications from the experiment. First, the need of a refine- ment technique for participatory innovation/design is established by the observa- tion that a large number of ideas from the original concept are eliminated. Sec- ond, the difference of opinion between innovators and refiners show that different end-users from the same population may diverge in creativity differently. Thus, some ideas generated during ideation may seem suitable to conceiver at that mo- ment, but may not be beneficial to the society at large. Third, the inter-rater con- sistency of refinement establishes that end-user can refine, contrary to the popular belief that only experts can evaluate and refine due to their previous knowledge. Keywords: Participatory Refinement, Idea Refinement, Design Creativity, Par- ticipatory Design, mlearning. 1 Introduction There is a growing debate in literature on the extent of end-user involvement in the development lifecycle—from ideation to design, and implementation to deployment and evaluation—of an innovation. Some experts believe that end-users shall not be in- cluded into ideation phase. They argue that the users are usually stuck with their current technologies and cannot envisage the future well [1, 2]. Others believe in user involve- ment throughout all phases of innovation lifecycle—from ideation to evaluations—ar- guing that only the users know about their wants, needs, tasks, routines and the missing