Performance-based Metrics for Evaluating Submarine Command Team Decision-making Eric Jones 1 , Ronald Steed 2 , Frederick Diedrich 1 , Robert Armbruster 3 , Cullen Jackson 1 1 Aptima, Inc., Woburn, MA, USA {ejones, diedrich, cjackson}@aptima.com 2 UpScope Consulting, Mystic, CT, USA ronaldsteed@gmail.com 3 CGI, Norfolk, VA, USA robert.armbruster@stanleyassociates.com Abstract. Successful submarine operations—those that accomplish the mission while maintaining security and safety—depend on numerous factors, including the capabilities of various sensor systems, the reliability of algorithms, and the proficiency of the crew. Among the most critical elements is Command Team decision-making and the underlying processes that create a cohesive and effective team. As a team, submarine commanders must successfully contend with complexities associated with safety and security as they build an understanding of the operational environment in order to accomplish their mission. Hence, opportunities to enhance training to support Command Team decision-making are essential. This paper describes a framework used to develop performance measures to support formative assessment of the submarine Command Team. Results are reported here from a study at the Naval Submarine School concerning the validity and utility of the measures in relation to capturing essential aspects of performance. Keywords: performance measures, formative assessment, decision-making, teamwork, submarine 1 Introduction 1.1 The Challenge Successful submarine operations—those that accomplish the mission while maintaining security and safety—are exceedingly difficult to achieve. These operations depend on numerous factors including items such as the capabilities of various sensor systems, the reliability of algorithms, and the proficiency of the crew. Among the most critical elements is Command Team decision-making and the underlying processes that create a cohesive and effective team. As a team, submarine commanders must successfully contend with complexities associated with safety and security as they build an understanding of the operational environment in order to