103 JERE 11 (1) 2022 103-113 Journal of Educational Research and Evaluation http://journal.unnes.ac.id/sju/index.php/jere Validity and Reliability Analysis Using the Rasch Model to Measure the Quality of Mathematics Test Items of Vocational High Schools Nur Romdlon Maslahul Adi 1 , Hidar Amaruddin 2 , Habib Maulana Maslahul Adi 3 , Isna Laili Qurroti A’yun 4 1 Universitas Islam Negeri Sunan Ampel, Surabaya, Indonesia 2 Universitas Nahdlatul Ulama Yogyakarta, Indonesia 3 Universitas Islam Negeri Sunan Kalijaga, Yogyakarta, Indonesia 4 Universitas Diponegoro, Semarang, Indonesia Article Info ________________ History Articles Received: 10 May 2022 Accepted: 12 June 2022 Published: 30 August 2022 ________________ Keywords: Item response theory, rasch model, winsteps ____________________ Abstract ___________________________________________________________________ Teachers are expected to be able to evaluate the learning process and also be able to develop evaluation tools or instruments used in the learning process. Test items are considered appropriate if they are valid and able to measure the level of suitability and reliability or consistency. The purpose of this study was to analyze the quality of the test items and the mathematical ability of the XII grade students of the State Vocational School in one of State Vocational School in Semarang District. This research is a quantitative descriptive study that describes the quality of the mathematics test items made by the teacher and the students' abilities in mathematics. The subjects in this study were 126 student response patterns to the test instrument in the form of multiple choice questions totaling 20 items for class XII students. Rasch model was used to analyze this research with the help of Winsteps 3.73 software. A total of 20 items were tested, there was only one item, namely item number 7, which did not fit, which means it does not function normally to measure students' abilities. The ability of students who are relatively weak with Person Reliability of 0.48. The results showed that the quality of the test items was applicable. This is indicated by the Item Reliability value of 0.95 which means that the items are very good for evaluating students' abilities.  Correspondence Address : Universitas Islam Negeri Sunan Ampel Surabaya Jl. Ahmad Yani No.117, Jemur Wonosari, Kec. Wonocolo, Kota Surabaya, Jawa Timur 60237 E-mail : nur.romdlon.maslahul.adi@uinsby.ac.id p-ISSN 2252-6420 e-ISSN 2503-1732