Network Performance Testing System Integrating Models for Automatic QoE Evaluation of Popular Services: YouTube and Facebook Francisco Lozano • Gerardo Go ´mez • Mari-Carmen Aguayo-Torres • Carlos Ca ´rdenas • Antonio Plaza • Antonio Garrido • Janie Ban ˜ os-Polglase • Javier Poncela Published online: 12 March 2015 Ó Springer Science+Business Media New York 2015 Abstract Smartphones have significantly changed the traffic pattern usage of mobile subscribers. In addition to the classical file sharing and web browsing usage, social net- working applications and access to video content are now a significant percentage of the typical user data traffic consumption. As the change in usage pattern affects the performance of mobile networks, operators need methods to estimate how well the network behaves. The metrics to use for the evaluation of the quality of experience (QoE) are only well documented for traditional applications. In this paper a novel QoE system that automatically captures and processes the metrics needed to evaluate two commonly used applications, the social networking application Facebook and the video download application YouTube, is presented. The system uses a test application developed for Android phones, which report the results to a centralized platform capable of processing and presenting the results in different formats. The system has been used to test those two services over 3G/LTE network technologies. In the case of the YouTube services, performance results show a subjective score very similar for the 3G and LTE because of the automatic adaptation of the video coding rate to the network conditions. Testing of the Facebook application has led to the proposal of a new MOS expression that takes into account the content type being posted, which provides more reasonable MOS estimations than the generic web browsing models available in the literature and commonly used to estimate Facebook QoE. Keywords Quality of experience  Mean opinion score  YouTube TM  Facebook  Android F. Lozano (&)  G. Go ´mez  M.-C. Aguayo-Torres  J. Ban ˜os-Polglase  J. Poncela Departamento de Ingenierı ´a de Comunicaciones, Universidad de Ma ´laga, Campus de Teatinos, 29071 Ma ´laga, Spain e-mail: flg@ic.uma.es M.-C. Aguayo-Torres e-mail: aguayo@ic.uma.es C. Ca ´rdenas  A. Plaza  A. Garrido Performance testing solutions, AT4 wireless, Parque Tecnolo ´gico de Andalucı ´a, C/ Severo Ochoa, 2, 29590 Ma ´laga, Spain 123 Wireless Pers Commun (2015) 81:1377–1397 DOI 10.1007/s11277-015-2479-y