Noname manuscript No. (will be inserted by the editor) Enhancing Biometric Recognition with Spatio-Temporal Reasoning in Smart Environments Vivek Menon · Bharat Jayaraman · Venu Govindaraju Received: date / Accepted: date Abstract We discuss smart environments that identify and track their occupants using unobtrusive recognition modalities such as face, gait, and voice. In order to alleviate the inherent limitations of recognition, we propose spatio-temporal reasoning techniques based upon an analysis of the occupant tracks. The key idea underlying our approach is to determine the identity of a person based upon information from a track of events rather than a single event. We abstract a smart environment by a probabilistic state transition system in which each state records a set of individuals who are present in various zones of the smart environment. An event abstracts a recognition step and the transition function defines the mapping between states upon the occurrence of an event. We express two forms of spatio- temporal reasoning in the form of transition functions: a track-based transition function and an error-correcting transition function. We also define the concepts of ‘precision’ and ‘recall’ to quantify the performance of the smart environment, and provide experimental results to clarify the performance improvements from spatio-temporal reasoning. Our conclusion is that the state transition system is an effective abstraction of a smart environment and the application of spatial- temporal reasoning enhances the overall performance of a biometric recognition system. Keywords Smart environments · Biometrics · Recognition · Spatio-Temporal Reasoning · Precision · Recall · Abstract Framework · Events · States · Transitions Bharat Jayaraman Department of Computer Science and Engineering University at Buffalo, Buffalo, NY 14260, USA Tel: +1-716-645-4755 Fax: +1-716-645-3464 E-mail: bharat@buffalo.edu Venu Govindaraju Center for Unified Biometrics and Sensors University at Buffalo, Buffalo, NY 14260, USA E-mail: govind@buffalo.edu Vivek Menon Amrita Vishwa Vidyapeetham, Kochi 682041, India E-mail: vivek menon@cb.amrita.edu