Heuristics and Usability of a Video Assessment Evaluation Tool for Teachers Sara Cruz 1 a , Clara Coutinho 2 b and José Alberto Lencastre 2 c 1 School of Technology, Polytechnic Institute of Cávado and Ave, Campus Barcelos, 4750-810, Barcelos, Portugal 2 Institute of Education, University of Minho, Campus Gualtar, 4710-057, Braga, Portugal Keywords: Technology-enhanced Learning, Deeper Understanding, Usability. Abstract: The article presents the design and development of an organized multimedia Web tool to help teachers evaluate videos produced by students according to the JuxtaLearn learning process. We use a development research methodology, fulfilling the following phases of the protocol: (1) preliminary investigation, (2) theoretical embedding, (3) empirical testing and (4) documentation, analysis and reflection on process and outcomes. We started with the exploratory analysis phase where it was intended identify scientificity and pedagogical potential of the video. Based on the data obtained in this phase, the tool was designed and further developed. Usability evaluation tests were carried out with experts and the target audience in order to adapt the product. Based on the results of usability testing, we can say that the prototype responded to the teachers' needs, arousing their interest in promoting video production with their students. 1 INTRODUCTION Video editing by student can lead to reflection on their own learning (Otero et al., 2013; Adams et al., 2013). The editing process can improve the quality of reflection around concepts (Fadde, Aud, & Gilbert, 2009; Forman, 2000).These reflection are considered important factors for learning (Novak, 2010). By stimulating creativity through the video creation process, students have the opportunity to reflect on the information they collect and clarify possible mistakes (Adams et al., 2013; Otero et al., 2013) and identify doubts about the concepts focused (Hechter & Guy, 2010). Video construction allows a creative process for success in understanding concepts, leading to a shared understanding of a potentially difficult theme or concept (Fuller & Magerko, 2011). The use of video in an educational context has aroused interest on some researchers, but the difficulty of evaluating the videos constructed by the students led us to think of an evaluation instrument by points, that allows to estimate / evaluate the student's level of understanding only viewing the video. This reflection coupled with the guidelines obtained from a https://orcid.org/0000-0002-9918-9290 b https://orcid.org/0000-0002-2309-4084 c https://orcid.org/0000-0002-7884-5957 the literature in the area of video in education and in the area of knowledge assessment triggered this construction work of an instrument that allows the teacher who accompanied a video editing process by the student, viewing the video, estimate his level of understanding about the content. In this article, we present the design and development of a video assessment tool to be used by teachers who applied the Juxtalearn learning process. The development process of this assessment instrument took place over the following phases: (1) preliminary investigation, (2) theoretical embedding, (3) empirical testing and (4) Documentation, analysis and reflection on process and outcomes. We started with an exploratory analysis phase and based on the data obtained and the existing theoretical references on Bloom Digital Taxonomy, we proceeded to the design and subsequent construction of an instrument for observing the videos produced with the JuxtaLearn methodology that we present here. Throughout this process, evaluation tests were carried out with experts and with the target audience in order to adapt it to that audience. Cruz, S., Coutinho, C. and Lencastre, J. Heuristics and Usability of a Video Assessment Evaluation Tool for Teachers. DOI: 10.5220/0009570504450454 In Proceedings of the 12th International Conference on Computer Supported Education (CSEDU 2020) - Volume 2, pages 445-454 ISBN: 978-989-758-417-6 Copyright c  2020 by SCITEPRESS – Science and Technology Publications, Lda. All rights reserved 445