Validating the external quality subcharacteristics of software
products according to ISO/IEC 9126
Ho-Won Jung
⁎
Korea University Business School, Anam-dong 5Ka, Sungbuk-gu, Seoul 136-701, South Korea
Received 20 December 2006; accepted 11 March 2007
Available online 18 April 2007
Abstract
The study statistically tests the proposition of the ISO/IEC 9126 standard that higher external quality (quality when software is executed)
implies higher ‘quality in use’. For this purpose, the study based on 75 user survey data shows that individual external quality subcharacteristics
are positively associated with user satisfaction as defined in ‘quality in use’. This study also investigates the external quality subcharacteristics that
strongly influence user satisfaction. Our results provide guidance for the revision of the Standard as well as supporting management decisions (i.e.,
resource allocation) aimed at improving software product quality.
© 2007 Elsevier B.V. All rights reserved.
Keywords: ISO/IEC 9126; Marginal satisfaction; Ordered probit regression; Software quality characteristics; User satisfaction
1. Introduction
The competitive environment in the software market and the
needs of customers require that software developers focus on
user satisfaction as a measure of software product quality. User
satisfaction is often considered as the ultimate aim of quality
management and has a positive impact on organizational cost,
profit, and sales growth [27]. However, users are often dis-
satisfied with software quality [20]. In fact, widespread dis-
satisfaction in the United States led to recent legislation
governing software quality and suppliers' responsibility [21].
Thus, understanding the key quality attributes that influence user
satisfaction can lead to a competitive advantage in the software
market place by aiding management decisions such as resource
allocation, aimed at improving software product quality [22].
Investigation of the quality attributes that influence user
satisfaction requires the use of a quality model. A quality model
normally defines a set of quality attributes that may be present in
software product. In particular, because users place different
values on each attribute depending on the product's use, it is
important that quality attributes are clear to the consumer.
Software engineering researchers and practitioners have
suggested many different quality models each with a varying
number of attributes [2,11,29]. Recently, in order to address the
issues of software product quality in a consistent way, ISO/IEC
9126 (Software Product Quality) [17] defined six character-
istics, 27 subcharacteristics, and their associated measures of
software product quality. A summarized explanation of quality
models and their attributes can be found in [23].
The proposition of ISO/IEC 9126 is that higher external
quality (quality when software is executed) indicates higher
‘quality in use’. Subcharacteristics of external quality are of
little value by themselves unless there is empirical evidence that
they are associated with important characteristics such as user
satisfaction, defined in ‘quality in use’.
The purpose of this study is to test the proposition by
showing that each of the subcharacteristics of external quality is
positively associated with user satisfaction, defined in ‘quality
in use’. A univariate ordered probit regression [37] is applied to
75 user survey data based on the use of a query and reporting
tool. Ordered probit regression is useful for analyzing datasets
with a dependent variable of an ordered response scale of user
satisfaction [15]. In addition, this study investigates the external
Computer Standards & Interfaces 29 (2007) 653 – 661
www.elsevier.com/locate/csi
⁎
Tel.: +82 2 3290 1938; fax: +82 2 922 7220.
E-mail address: hwjung@korea.ac.kr .
0920-5489/$ - see front matter © 2007 Elsevier B.V. All rights reserved.
doi:10.1016/j.csi.2007.03.004