On the Intelligence of Moral Agency Helder Coelho 1 and Antônio Carlos da Rocha Costa 2 1 LabMAg, Faculdade de Ciências da Universidade de Lisboa, 1749-016 Lisboa, Portugal, hcoelho@di.fc.ul.pt 2 Escola de Informática, PPGINF, Universidade Católica de Pelotas, 96.010-000 Pelotas, RS, Brazil, rocha@atlas.ucpel.tche.br Abstract. More advanced and complex applications, such as serious games, where physical and virtual environments interchange with human and artificial agents and along heavy social simulations, require another sort of architectures. With the enlarging autonomy comes an increased need to ensure that their behaviour is in line what we expect from them. Therefore, a combination of intelligence and ethics becomes mandatory, and this means new design principles and technical requirements for the social agency and the presence of trust and confidence. Mentality, before the sole key concern, is now mixed with morality and within the social spaces where autonomous agents act on our behalf. In order to model new agent behaviours with qualities we need other kind of more intricate mental models, able to support moral reasoning capabilities. Today, the pressing quest is which are the crucial building blocks and mechanisms for those inovative agents. Keywords: moral agency, moral agents, norm innovation. 1 Introduction “The function of Moral is to guide action intuitively and unconsciously.” J. Greene, 2007. Environment, cognition, emotions, peer pressure, values, pride and the social relations all influence our decisions between choosing right over wrong. Any decision an agent makes when it comes to prefer a good or a bad behaviour reveals his true character. This implies also agents must have an explicit conception about the outcomes of their actions and the capability to classify and assess them accordingly. Agency is only the capacity of an agent to act in a world, yet moral agency is the responsability for making moral judgements about the acting choices, and morality refers to a certain code of conduct and a system of actions and reactions directed to keep everyone behaving according to it. In brief, Moral refers to those explicit and implicit rules and actions able to govern agents´s social behaviour. A clear understanding of how cultural changes interact with individual agent