BroadBand Europe Bordeaux, France 12-14 December 2005 Page 1 of 5 Perceived Quality of Service in MUSE lab trials and demos Robert Kooij 1,2 , Jeroen van Vugt 1 , Magnus Olson 3 , Kjell Brunnström 3 , António Gamelas 4 ¹ TNO Information and Communication Technology, Delft, the Netherlands, {r.e.kooij,j.m.vanvugt} @telecom.tno.nl ² Delft University of Technology, Faculty of Electrical Engineering, Mathematics and Computer Science 3 Acreo, Kista, Sweden, {magnus.olson,kjell.brunnstrom} @acreo.se 4 Portugal Telecom Inovação, Aveiro, Portugal, agamelas@ptinovacao.pt Abstract End-to-end tests and evaluations, as a proof of concept, are essential tools in the development of innovative telecommunication concepts and platforms. Within the integrated project MUSE (Multiservice access everywhere) we have put extensive efforts in defining a complete test suite for full-service end-to-end testing. This test suite describes what and how to test. In this paper we focus on one specific aspect of the test suite i.e. perceived Quality of Service. The test suite for Voice over IP is presented and the results from a test setup between the Netherlands and Sweden, where the perceived QoS have been estimated for a particular network connection. Introduction The overall objective of MUSE is the research and development of a future low cost, full service access and edge network, which enables the ubiquitous delivery of broadband services to every European citizen. The project integrates studies in the following areas: • Access and edge network architectures and techno- economical studies • Access and edge platforms • First mile solutions • Interworking of the access network with home gateway and local networks The high bandwidth access solutions developed within MUSE should have multi-service and multi-hosting capability, enable low investment cost and operational expenses and they should be easy to use and utilize for the end users. In MUSE novell access platforms are developed enabling end-to-end solutions. Within the MUSE lab trials and demonstration Taskforce (TF4) extensive effort is put in defining a complete test suite for full-service end-to-end testing. This test suite describes what and how to test. In this paper we will focus on the test methods with respect to perceived QoS. Motivation for a focus on perceived QoS There are several perspectives with respect to QoS: perceived QoS, network quality, terminal quality and QoS mechanisms that are supported by the network entities, see Figure 1. Figure 1: Four QoS perspectives A preliminary consideration has to be done about the set of definitions related to QoS and network performance that are defined in ITU-T E.800 [1]. Regarding the user perceived service quality, e.g., for the voice service, examples of general key performance indicators (KPI) are: • Call set-up time, • Dial Tone Delay, • Call Success Ratio, • Call Completion Rate, • Billing correctness, • End-to-end perceived transmission quality. Throughout this paper, only the last KPI, the perceived transmission quality, will be discussed extensively. The MUSE lab trials will have a focus on the perceived QoS because in the end the European citizen has to be satisfied with the quality of the services enabled by the novel access platforms developed. Therefore each selected application will be analyzed in terms of these perceptual quality factors. We have tested and evaluated this concept for a particular Voice over IP (VoIP) device, for which we present the test suite and the results from test setup between TNO in the Netherlands and Acreo in Sweden.