Copyright © Lippincott Williams & Wilkins. Unauthorized reproduction of this article is prohibited.
Evaluation of Patient Satisfaction Surveys in
Pediatric Orthopaedics
Lee S. Segal, MD, Carla Plantikow, MSc, Randon Hall, MBA, MD, Kristina Wilson, MD, MPH,
and M. Wade Shrader, MD
Background: Patient satisfaction survey scores are increasingly
being tied to incentive compensation, impact how we practice
medicine, influence decisions on where patients seek care, and in
the future may be required for accreditation. The goal of this
study is to compare the results of an internal distribution of
patient satisfaction surveys at the point of care to responses
received by mail in a hospital-based, high-volume pediatric or-
thopaedic practice.
Methods: A pediatric outpatient survey is used at our institution
to evaluate patient satisfaction. Surveys are randomly mailed
out to families seen in our clinic by the survey vendor, and the
results are determined on a quarterly basis. We distributed
the same survey in a similar manner in our clinic. The results of
the surveys, external/mailed (EXM) versus internal/point of care
(INP) over the same 3-month time period (second quarter 2013)
were compared. The survey questions are dichotomized from an
ordinal scale into either excellent (9 to 10) or not excellent (0 to
8) commonly used in patient satisfaction methodology. We
evaluated the raw data from the INP surveys for the question on
provider rating by evaluating the mean score, the standard ex-
cellent response (9 to 10), and an expanded excellent response
(8 to 10).
Results: Response rate was 72/469 (15.4%) for EXM, and 231/
333 (69.4%) for INP. An excellent response for the “rating your
provider” question was 72.2% (EXM) versus 84.8% (INP)
(P = 0.015). Our analysis of the raw data (INP) has a mean
rating of 9.42. The expanded scale (8 to 10) for an excellent
response increased the provider rating to 94.4% (P = 0.001).
Waiting time response within 15 minutes was the only item that
correlated with rating of provider (P = 0.02). For the majority
of the items, the INP responses were consistently higher than the
EXM responses, including 6/7 responses that were statistically
significant (P < 0.05).
Conclusions: As mandated by the Centers for Medicare and
Medicaid Services, patient satisfaction surveys will be important
in determining health care outcomes. Properly designed and
administered surveys provide robust measures of quality. Our
study reinforces methodological concerns about patient sat-
isfaction surveys distributed in a high-volume pediatric sub-
specialty practice. Further research is needed to evaluate the
patients’ health care experience and true quality of care in pe-
diatric subspecialty ambulatory settings.
Key Words: patient satisfaction surveys, health care outcomes,
pediatric orthopaedics
(J Pediatr Orthop 2014;00:000–000)
T
he patient care experience or patient satisfaction has
become an increasingly important measure of health
care quality. In 2001, the Institute of Medicine defined
patient-centered care as one of the specific goals for im-
provement needed for health care to bridge the quality
chasm existing in the present health care environment.
1
The Centers for Medicare and Medicaid Services (CMS)
included patient satisfaction as a quality mandate in
2008.
2
Patient satisfaction is thought by several authors to
be a complex concept, often dependent on specific patient
characteristics and expectations.
3–5
Another important
aspect of patient satisfaction is the perception of the care
actually received. These include the technical quality of
care, the interpersonal skills of the physician, and acces-
sibility/availability.
3,5
Measurement of patient satisfaction by patient
survey scores are increasingly being tied to incentive
compensation, and used for benchmarking of both
physicians and hospitals by specialties and geographic
areas. Medicare reimbursements to health care facilities
could decrease by as much as 2% if hospitals do not meet
benchmark patient satisfaction goals determined by the
CMS. These surveys may also impact how we practice
medicine, influence decisions on where patients seek care,
and in the future may be required for accreditation.
2,6–9
An entirely new industry centered on health care–related
patient satisfaction surveys has evolved with the man-
dates from the CMS to measure patient satisfaction.
The literature is replete with concerns regarding
patient satisfaction questionnaires. These include the
types of surveys used, how surveys are constructed, how
the surveys are distributed,
6,10–13
timing of survey dis-
tribution,
7,14,15
response rates and nonresponse
bias,
12,16–20
costs associated with survey administration
and distribution,
6,7
the impact on physician pro-
ductivity,
21
and the impact on resident training.
22
From the Center for Pediatric Orthopaedics, Phoenix Children’s Hos-
pital, Phoenix, AZ.
The authors declare no conflicts of interest.
Reprints: Lee S. Segal, MD, Department of Orthopedics and Re-
habilitation, University of Wisconsin School of Medicine and Public
Health, UWMF Centennial Building, 1685 Highland Avenue,
Madison, WI 53705-2281. E-mail: segal@ortho.wisc.edu.
Copyright
r
2014 by Lippincott Williams & Wilkins
ORIGINAL ARTICLE
J Pediatr Orthop
Volume 00, Number 00, ’’ 2014 www.pedorthopaedics.com
|
1