This is an Open Access article distributed under the terms of the Creative Commons Attribution-Noncommercial 4.0 Unported License, permitting all non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited. WLC 2016 : World LUMEN Congress. Logos Universality Mentality Education Novelty 2016 | LUMEN 15th Anniversary Edition The Role of Monitoring Raters in Ensuring Accurate and Meaningful Test Scores. Case Study: RFL Examinations Lavinia Vasiu a *, Antonela Arieșan b * Corresponding author: Lavinia Vasiu, laviniavasiu@gmail.com a Babeș-Bolyai University, Cluj-Napoca, Romania, laviniavasiu@gmail.com b Babeș-Bolyai University, Cluj-Napoca, Romania, antonela.suciu@gmail.com Abstract Providing accurate and meaningful test scores is an extremely important issue especially in the case of high-stakes examinations like the one considered here: the RFL examination, level B2, which practically conditions the admission of students to an academic program in Romanian. The paper aims to describe and explain how data regarding the achievement of raters are collected and analysed in order to ensure rating accuracy and rater reliability. Monitoring, co-ordination, standardization measures all aim at dealing with problems of leniency, inconsistency or severity of raters. The paper details the procedures used for calculating rating accuracy, intra-rater reliability, inter-rater agreement in the case of marking both receptive and productive components of the RFL examination. © 2016 Published by Future Academy www.FutureAcademy.org.uk Keywords: Raters; monitoring; standardization; reliability; accuracy; agreement. http://dx.doi.org/10.15405/epsbs.2016.09.132