Speech and Face to Face Communication Workshop in memory of Christian Benoît 16 University Paris 8, 140 rue de la Nouvelle France 93100, Montreuil, France INRIA Rocquencourt, Mirages BP 105, 78153 Le Chesnay Cedex, France We propose a system that computes the behaviour of a listening agent. Such an agent, developed within the Sensitive Artificial Listening Agent project, must exhibit varied behaviour. The verbal and non verbal communication depends not only on the agent's mental state towards the interaction (, if it agrees or not with the speaker) but also on the agent's characteristics such as its emotional traits and its behaviour style. Our system computes the behaviour of the listening agent in real9 time. !" A big challenge that must be faced in the design of virtual agents is the issue of credibility, not only in the agent's aspect but also in its behaviour. Users tend to react as if in a real human9human interaction when the virtual agent behaves in a natural human manner (Nass , 1994; Reeves & Nass, 1996. The work presented in this paper focuses on the listener's behaviour and is set within the Sensitive Artificial Listening Agent (SAL) project, which is part of the EU STREP SEMAINE project (http://www.semaine9project.eu). This project aims to build an autonomous talking head able to exhibit appropriate behaviour when it plays the role of the listener in a conversation with a user. Four characters, with diRerent emotional styles, invite the user to chat trying to induce her/him in a particular emotional state. Within SAL, we aim to build a real9time Embodied Conversational Agents (ECAs) able to automatically generate those verbal and non verbal signals that a human interlocutor displays during an interaction. These signals, called backchannels, provide information about the listener's mental state towards the speaker's speech (, if s/he believes or not what the speaker is saying). In our system backchannel signals are emitted not only according to the agent's mental state towards the interaction but also its behaviour tendencies, that is the particular way of producing non verbal signals that characterizes the agent. In our work the behaviour tendencies are defined by the preference the agent has in using each available communicative modality (head, gaze, face, gesture and torso) and a set of parameters that affect the qualities of the agent's behaviour ( wide narrow gestures). We call the behaviour tendencies the agent's baseline. The proposed work incorporates a pre9existing system for the generation of distinctive behaviour in ECAs (Mancini & Pelachaud, 2007; Mancini & Pelachaud, 2008). The result is a system capable of computing the verbal and non9verbal behaviours that the agent, in the role of the listener, has to perform on the basis of both its baseline and its mental state. #$%!& This work has been funded by the STREP SEMAINE project IST9211486 (http://www.semaine9 project.eu) and the IP9CALLAS project IST9034800 (http://www.callasnewmedia.eu). ’ Mancini, M. & Pelachaud, C., 2007. Dynamic behavior qualiers for conversational agents. In Intelligent Virtual Agents, pp. 1129124. Mancini, M. & Pelachaud, C., 2008. Distinctiveness in multimodal behaviors. In Conference on Autonomous Agents and Multiagent System. Nass, C., Steuer, J. & Tauber, E. R., 1994. Computers are social actors. In CHI, pp. 72978. Reeves, B. & Nass, C., 1996. The media equation: How people treat computers, television and new media like real people and places. CSLI Publications, Stanford, CA.