Multilinear modeling for robust identity recognition from gait Fabio Cuzzolin Oxford Brookes University Oxford, UK Abstract Human identification from gait is a challenging task in realistic surveillance scenarios in which people walking along arbitrary directions are viewed by a single camera. However, viewpoint is only one of the many covariate factors limiting the efficacy of gait recognition as a reliable biometric. In this chapter we address the problem of robust identity recognition in the framework of multilinear models. Bilinear models, in particular, allow us to classify the “content” of human motions of unknown “style” (covariate factor). We illustrate a three-layer scheme in which image sequences are first mapped to observation vectors of fixed dimension using Markov modeling, to be later classified by an asymmetric bilinear model. We show tests on the CMU Mobo database that prove that bilinear separation outperforms other common approaches, allowing robust view- and action-invariant identity recognition. Finally, we give an overview of the available tensor factorization techniques, and outline their potential applications to gait recognition. The design of algorithms insensitive to multiple covariate factors is in sight. Introduction Biometrics has received a growing attention in the last decade, as automatic identification systems for surveillance and security started to enjoy widespread diffusion. Biometrics like face, iris, or fingerprint recognition, in particular, have been thoroughly employed. They suffer, however, from two major limitations: they cannot be used at a distance, and require user cooperation. Such assumptions are simply not sensible in real-world scenarios, e.g. surveillance of public areas. Interestingly, psychological studies show that people are capable of recognizing their friends just from the way they walk, even when their “gait” is poorly represented by point light display (Cutting & Kozlowski, 1977). Gait has several advantages over other biometrics, as it can be measured at a distance, is difficult to disguise or occlude, and can be identified even in low-resolution images. Most importantly gait recognition is non-cooperative in nature. The person to identify can move freely in the surveyed environment, and is possibly unaware of his/her identity being checked. The problem of recognizing people from natural gait has been studied by several researchers (Gafurov, 2007; Nixon & Carter, 2006), starting from a seminal work of Niyogi and Adelson (1994). Gait analysis can also be applied to gender recognition (Li et al., 2008), as different pieces of information like gender or emotion are contained in a walking gait and can be recognized. Abnormalities of gait patterns for the diagnosis of certain diseases can also be automatically detected (Wang, 2006). Furthermore, gait and face biometrics can be easily integrated for human identity recognition (Zhou & Bhanu, 2007; Jafri & Arabnia, 2008). Influence of covariates Despite of its attractive features, though, gait identification is still far from being ready to be deployed in practice.