Traffic Records Forum Proceedings Paper Applying user feedback to improve data access and usability: Massachusetts beta test results Heather A. Rothenberg a, * , Michael Knodler b,1 , Robin Riessman a,2 a MassSAFE, University of Massachusetts, Amherst, 139 Marston Hall, Amherst, MA 01003, USA b University of Massachusetts, Amherst, 214 Marston Hall, Amherst, MA 01003, USA Available online 16 November 2005 Keywords: Data warehouse; User feedback; Highway safety; Traffic records; Crash data 1. Problem statement Highway safety decision-makers require timely access to quality data from a wide variety of sources. The Massachu- setts data warehouse and Interactive Data Retrieval System (IDRS) were developed to provide state and federal highway safety decision-makers with access to a variety of safety-related data through a common user interface that allows users with varying levels of data analysis skill to query data. The Massachusetts data warehouse currently houses 13 data sets and provides online access to nine of those data sets through the IDRS. Upon implementation of the original system, the Governor’s Highway Safety Bureau (GHSB), which funded the project, and the Massachusetts Traffic Safety Research Program (MassSAFE) at the University of Massachusetts Amherst, which developed the system, requested a study to determine if the system met user needs, and what changes could be made to improve usability. 2. Method In the Fall of 2003, the IDRS was opened with two modules for limited use by traffic safety stakeholders. An Online Query Tools module provided access for querying data through three tools aimed at meeting the needs of users with different query skill levels: Easy Chart, Query Tool, and Ad Hoc Query Tool. A Technical Assistance module allowed users to submit electronic requests for assistance. During the official beta test period for the website beginning in January 2004, the website was opened to all interested traffic safety stakeholders from agencies for whom this tool was designed. These included the following stakeholders: transportation engineering, public health, emergency room and medical care providers, enforcement, planning, federal and state highway safety agencies, and highway safety advocacy groups. This beta test period allowed users to access data stored in the Massachusetts Data Warehouse while identifying weak spots in the design and implementation of the IDRS prior to its release to a larger user audience. Of the more than 100 users who were granted access to Registry of Motor Vehicles (RMV) crash data from 1990 –2000 through the Online Query Tools, approximately 75 were asked to provide feedback. Approx- imately one-half of those users provided feedback either by responding to the questionnaire or participating in a phone survey. 3. Results During the beta test period, website use was tracked. Usage peaked at 1400 queries in one month with the average execution time ranging from seven to nine seconds. Feedback provided by users covered five areas: general website navigation, online query tool use, usability of data, 0022-4375/$ - see front matter D 2005 National Safety Council and Elsevier Ltd. All rights reserved. doi:10.1016/j.jsr.2005.10.005 * Corresponding author. Tel.: +1 413 577 4304; fax: +1 413 577 1036. E-mail addresses: hrothenb@acad.umass.edu (H.A. Rothenberg)( mikeknod@aol.com (M. Knodler)( riessman@ecs.umass.edu (R. Riessman). 1 Tel.: +1 413 545 0228; fax: +1 413 577 1036. 2 Tel.: +1 413 577 1035; fax: +1 413 577 1036. Journal of Safety Research - Traffic Records Forum proceedings 36 (2005) 469 – 471 www.nsc.org www.elsevier.com/locate/jsr