Automatic Programming Assessment to Measure Programming Problem-Solving Skills Rina Harimurti 1* , Yeni Anistyasari 2 , Puput Wanarti Rusimamto 3 , Subuh Isnur Haryudo 4 {rinaharimurti@unesa.ac.id 1 , yenian@unesa.ac.id 2 , puputwr@unesa.ac.id 3 , subuhharyudo@unesa.ac.id 4 } Faculty of Engineering, Universitas Negeri Surabaya, Surabaya, Indonesia Abstract. Problem-solving skills today form an integral part of the curriculum and meet student needs because they have become a problem in the dominant field of education. Computer programming is a subject that requires problem-solving strategies and involves a large amount of logical programming activity. Therefore, one alternative method of introducing problem-solving skills is through computer programming. With the development of programming software and industrial needs, which are supported by operations in the industry, progressing so fast, the existence of software that is able to automatically assess the results of student work and assignments is needed, especially in vocational schools. This research generally aims to implement an automatic assessment tool that can help teachers make corrections on student work related to computer programming. This type of research is quantitative and descriptive; the results are presented in the form of a research report with data analysis using SEM. The results showed that the automatic assessment system used was reliable, and the instrument for measuring the problem-solving skills of subjects had good construct validity, with the LF of each indicator worth 0.50. Keywords: automatic scoring system, problem solving skills, computer programming 1 Introduction Problem solving skills are considered as very important and needed, to be able to function effectively and efficiently in meeting the demands of the world of education [1]. The ability to interpret new information efficiently and effectively will become more important than a person's specialized knowledge. This is an important reason why many countries have included problem solving as a central competency in the curriculum [2]. With the development of programming software and the industrial needs supported by operations in the industry progressing so fast, the existence of software that is able to automatically assess the results of student work and assignments is needed, especially in vocational schools. Taking into account the above background, a research was conducted that aims to implement an automatic assessment tool that can help teachers/teachers to make corrections on student work related to computer programming. 1.1 Automatic scoring system The automatic assessment system in this case is used for computer programming assessment, namely automatic programming assessment, which refers to software that was originally designed for programming competitions. Automatic Programming Assessment is a tool commonly used by teachers as an automatic assessment tool [3]. This application can help ACEIVE 2022, October 20, Medan, Indonesia Copyright © 2023 EAI DOI 10.4108/eai.20-10-2022.2328840