Assessment of Literacy and Numeracy of Indonesian Students Using the Integrated Science-based Science Literacy Test Purwo Susongko 1 {purwosusongko@upstegal.ac.id 1 } Universitas Pancasakti Tegal 1 Abstract. People’s high literacy and numeracy levels are significantly influenced by the development of a nation. This study aims at developing the assessment instruments on Senior High School science program students’ literacy and numeracy ability based on the integrated sciences. The literacy and numeracy indicators used were some indicators of the scientific and mathematics literacy achievements developed by PISA 2015. The literacy and numeracy test instruments were in the form of testlet consisting of 12 popular science readings containing 20 items measuring the literacy and 16 items measuring the numeracy. The instruments were tested to 310 XII grade students of SMAN 2 and SMAN 3 Tegal City. The test validity was examined using the Rasch model approach. The Senior High School science program students’ literacy and numeracy test instruments have met the validity aspects both related to the material and psychometric aspects. The construct validity aspects with the Rasch model approach showed that the Senior High School science program students’ literacy and numeracy test instruments were valid seen from the difficulty level and item appropriateness with the model. The literacy achievement of the XII Grade students of SMAN 2 and SMAN 3 Tegal City was 57.45 % while their numeracy achievement was 43.18 %. Keywords: Assessment. literacy, numeracy, integrated mathematics and natural sciences 1 Introduction People’s high literacy and numeracy levels are significantly influenced by the development of a nation. People’s scientific literacy positively influences the economic, democracy, cultural, individual development quality [1]-[3]. The future of a nation depends on its people with high scientific literacy levels to participate in various development fields as the society members possessing the information as well as the skillful scientific workforces who are ready to face the problematic challenges either in the local, national and global levels [4]. Therefore learning in schools must have an impact on improving students' literacy and numeracy skills. In order to find out the increase in these two aspects, it is necessary to develop an assessment model. To achieve those literacy and numeracy achievements, the Republic of Indonesia Minister of Education and Culture, Nadiem Makarim starting in 2021 will change the National Examination with the minimum competency assessment and character survey. Nadiem has explained that what is meant by the minimum competency assessment refers to two elements: literacy and numeracy. The literacy meant here is not only related to the ability to but also the ability to analyze a text, ability to understand a concept behind the text. Furthermore, Nadiem BIS-HSS 2020, November 18, Indonesia Copyright © 2021 EAI DOI 10.4108/eai.18-11-2020.2311684