A purpose-based evaluation of information for patients: An approach to measuring effectiveness §,§§ Deb Feldman-Stewart a,b,c, * , Sarah Brennenstuhl a , Michael D. Brundage a,b,d a Division of Cancer Care and Epidemiology, Cancer Research Institute, Queen’s University, Kingston, Canada b Department of Oncology, Queen’s University, Kingston, Canada c Department of Psychology, Queen’s University, Kingston, Canada d Department of Community Health and Epidemiology, Queen’s University, Kingston, Canada Received 21 April 2006; received in revised form 15 August 2006; accepted 26 August 2006 Abstract Objective: To assess the feasibility, internal reliability, and validity, of an assessment tool, purpose-based information assessment (PIA), that we had developed to evaluate how effectively information provided to patients addresses their individual purposes for the information. The study also demonstrated potential novel insight gained by the PIA assessment. Methods: One hundred and eighty-two patients and family members were provided with a booklet on early-stage prostate cancer and its treatment options, in the context of a clinical trial comparing two booklets. Using the PIA, participants rated the importance (4-point Likert scale) of each of six previously identified common purposes for such information: to organize their thoughts, to understand their situation, to decide on treatment, to plan their future, to provide emotional support to others, and to discuss issues. Participants then rated how much their booklet helped address each of their purposes (4-point Likert scale). Evaluations were returned by mail. This report assesses the PIA evaluation of one of the booklets. Results: One hundred and fifty-six (86%) participants returned evaluations. Participants wanted information for a mean of 5.8 purposes (range 2–7); 72.5% rated the booklet at different levels of helpfulness across their purposes. The assessment showed internal reliability on three constructs tested, and convergent validity on 10 of 11 tested. PIA’s individualized purpose-based approach revealed how an overall assessment could be misleading: overall, the booklet was more effective at helping readers decide than at helping them plan (64.7% versus 55.8%, respectively, rated the booklet as ‘‘helpful’’ or better). However, among readers who rated the two purposes as ‘‘very important’’, the booklet had a mean helpfulness rating of 1.95 for deciding compared to a mean of 2.02 for planning. The result suggests that the booklet was not better at helping people decide than at helping them plan, for the readers who most needed the help. Conclusion: The PIA seems reliable and valid and adequately sensitive. The individualized purpose-based approach to assessing information appears to provide more specific feedback and more insights into its effectiveness than a single, global evaluation. Practice implications: Developers of information source or educational tools for patients can use an individualized purpose-based assessment, such as the PIA, to identify strengths and limitations of the tools more precisely than global assessments. # 2006 Elsevier Ireland Ltd. All rights reserved. Keywords: Information evaluation; Methods; Patient education; Patient information; Cancer 1. Introduction Widespread production of information for patients, particularly about health conditions and treatment options, has led to concerns about the quality of information that patients receive. One approach to addressing quality has been to establish guidelines for information production [1]; others have created assessment tools designed to evaluate www.elsevier.com/locate/pateducou Patient Education and Counseling 65 (2007) 311–319 § For more information on the Reflective Practice section please see: Hatem D, Rider EA. Sharing stories: narrative medicine in an evidence- based world. Patient Education and Counseling 2004;54:251–253. §§ Research supported by a grant from the National Cancer Institute of Canada #9254. * Corresponding author at: Division of Cancer Care and Epidemiology, Queen’s University Cancer Research Institute, Level 2, 10 Stuart St. Kingston, Ont. K7L 3N6, Canada. Tel.: +1 613 533 6000x78516. E-mail address: deb.feldman-stewart@krcc.on.ca (D. Feldman-Stewart). 0738-3991/$ – see front matter # 2006 Elsevier Ireland Ltd. All rights reserved. doi:10.1016/j.pec.2006.08.012