International Journal of Intercultural Relations 26 (2002) 473–491 The assessment of cross-cultural experience: measuring awareness through critical text analysis John E. Ingulsrud a, *, Kimiko Kai b , Seiko Kadowaki c , Shigeko Kurobane c , Mari Shiobara d a College of Humanities, Meisei University, 2-1-1 Hodokubo, Hino-shi, Tokyo 191-8506, Japan b Fuji Women’s College, Japan c Kyushu Lutheran College, Japan d Tokyo Gakugei University, Japan Abstract A holistic model of assessing cross-cultural experience is developed employing both authentic assessment and quantitative methods. Authentic assessment methods address the multi-faceted nature of cross-cultural experience. In this case, portfolios are used, involving the students in the assessment process. Within the context of portfolio assessment, a quantitative instrument is presented, measuring the degree of cross-cultural awareness by locating evidence of critical thinking in student-generated text. The intention of the quantitative instrument is to provide an index for the achievement of our educational objective, cross-cultural awareness. This assessment is carried out by multiple raters. Findings indicate that interrater reliability is maintained, and results from a study with independent raters suggest that the method can be easily acquired and conducted reliably. r 2002 Elsevier Science Ltd. All rights reserved. Keywords: Assessment; Text analysis; Cross-cultural communication; Study abroad; Critical thinking; Portfolio; Experiential learning 1. Introduction Studying abroad is a popular academic option for university students around the world. Most students study abroad for specific academic and professional objectives, pursuing educational opportunities that are not available at home, or seeking the *Tel.:/fax: +81-42-591-7227. E-mail address: john@eleal.meisei-u.ac.jp (J.E. Ingulsrud). 0147-1767/02/$-see front matter r 2002 Elsevier Science Ltd. All rights reserved. PII:S0147-1767(02)00030-5