Performance Evaluation 68 (2011) 938–954
Contents lists available at ScienceDirect
Performance Evaluation
journal homepage: www.elsevier.com/locate/peva
A refined EM algorithm for PH distributions
Hiroyuki Okamura
a,∗
, Tadashi Dohi
a
, Kishor S. Trivedi
b
a
Department of Information Engineering, Graduate School of Engineering, Hiroshima University, 1–4–1 Kagamiyama, Higashi-Hiroshima 739–8527, Japan
b
Department of Electrical and Computer Engineering, Duke University, Hudson Hall, Durham 27707, USA
article info
Article history:
Received 24 December 2009
Received in revised form 22 March 2011
Accepted 11 April 2011
Available online 1 May 2011
Keywords:
PH distribution
PH fitting
EM algorithm
Canonical form
Uniformization
abstract
This paper proposes an improved computation method of maximum likelihood (ML)
estimation for phase-type (PH) distributions with a number of phases. We focus on the
EM (expectation-maximization) algorithm proposed by Asmussen et al. [27] and refine
it in terms of time complexity. Two ideas behind our method are a uniformization-
based procedure for computing a convolution integral of the matrix exponential and an
improvement of the forward–backward algorithm using time intervals. Compared with the
differential-equation-based EM algorithm discussed in Asmussen et al. [27], our approach
succeeds in the reduction of computation time for the PH fitting with a moderate to
large number of phases. In addition to the improvement of time complexity, this paper
discusses how to estimate the canonical form by applying the EM algorithm. In numerical
experiments, we examine computation times of the proposed and differential-equation-
based EM algorithms. Furthermore, the proposed EM algorithm is also compared with the
existing PH fitting methods in terms of computation time and fitting accuracy.
© 2011 Elsevier B.V. All rights reserved.
1. Introduction
A phase-type (PH) distribution is defined as the probability distribution of the time to absorption in a finite state Markov
chain with one or more transient states and one absorbing state. PH distributions include several important distributions
such as the Erlang, the hypoexponential and the hyperexponential distributions. An advantage of PH distributions is their
mathematical tractability. Since PH distributions are easily combined with Markov models, they are often utilized in
modeling queueing systems, insurance risk and dependability/performance of technical systems [1–4].
PH distributions can approximate arbitrary continuous probability distributions with arbitrary precision. Thus the
PH approximation is popular as an approximation to a general distribution in quantitative dependability/performance
evaluation. For example, Markov regenerative stochastic Petri nets (MRSPNs) and their associated Markov regenerative
analysis are often used in the performance evaluation of communication systems [5–7]. Since the MRSPNs involve general
distributions as well as exponential distributions, PH distributions can be applied as a method of approximate solution of
MRSPNs. For this reason, some MRSPN tools incorporate the PH approximation [8–10].
A significant problem in PH fitting is the estimation/approximation of parameters. In general, three kinds of criteria
are applied to the parameter estimation of PH distributions: moment matching, difference in probability densities and
Kullback–Leibler (KL) divergence [11]. Table 1 presents a classification of PH estimation/approximation methods based
on the three criteria. The second column in Table 1 represents the class of PH distributions that is used in the parameter
estimation.
To the best of our knowledge, moment matching was the first method adopted for PH fitting. Marie [12] proposed a
simple method by using the first two moments to fit either Coxian or Erlang distributions. The method was extended by
∗
Corresponding author. Tel.: +81 82 424 7697; fax: +81 82 422 7025.
E-mail address: okamu@rel.hiroshima-u.ac.jp (H. Okamura).
0166-5316/$ – see front matter © 2011 Elsevier B.V. All rights reserved.
doi:10.1016/j.peva.2011.04.001