Assessing the Novelty of Computer-Generated Narratives Using Empirical Metrics Federico Peinado Virginia Francisco Raquel Herva ´s Pablo Gerva ´s Received: 16 October 2009 / Accepted: 29 March 2010 / Published online: 8 October 2010 Ó Springer Science+Business Media B.V. 2010 Abstract Novelty is a key concept to understand creativity. Evaluating a piece of artwork or other creation in terms of novelty requires comparisons to other works and considerations about the elements that have been reused in the creative process. Human beings perform this analysis intuitively, but in order to simulate it using computers, the objects to be compared and the similarity metrics to be used should be formalized and explicitly implemented. In this paper we present a study on relevant elements for the assessment of novelty in computer-generated narratives. We focus on the domain of folk-tales, working with simple plots and basic narrative elements: events, characters, props and scenarios. Based on the empirical results of this study we propose a set of computational metrics for the automatic assessment of novelty. Although oriented to the implementation of our own story generation system, the measurement methodology we propose can be easily generalized to other creative systems. Keywords Similarity metrics Novelty assessment Story generation Creative systems Computational creativity F. Peinado (&) V. Francisco R. Herva ´s Departamento de Ingenierı ´a del Software e Inteligencia Artificial, Facultad de Informa ´tica, Universidad Complutense de Madrid, Madrid, Spain e-mail: fpeinado@fdi.ucm.es V. Francisco e-mail: virginia@fdi.ucm.es R. Herva ´s e-mail: raquelhb@fdi.ucm.es P. Gerva ´s Instituto de Tecnologı ´a del Conocimiento, Universidad Complutense de Madrid, Madrid, Spain e-mail: pgervas@sip.ucm.es 123 Minds & Machines (2010) 20:565–588 DOI 10.1007/s11023-010-9209-8