Multimodal Gait Recognition Under Missing Modalities - École polytechnique Access content directly
Conference Papers Year : 2021

Multimodal Gait Recognition Under Missing Modalities


Multimodal systems for gait recognition have gained a lot of attention. However, there is a clear gap in the study of missing modalities, which represents real-life scenarios where sensors fail or data get corrupted. Here, we investigate how to handle missing modalities for gait recognition. We propose a single and flexible framework that uses a variable number of input modalities. For each modality, it consists of a branch and a binary unit indicating whether the modality is available; these are gated and merged together. Finally, it generates a single and compact 'multimodal' gait signature that encodes biometric information of the input. Our framework outperforms the state of the art on TUM-GAID and extensive experiments reveal its effectiveness for handling missing modalities even in the multiview setup of CASIA-B. The code is available online:
Fichier principal
Vignette du fichier
ICIP_2021_Multimodal_Gait_Recognition_Under_Missing_Modalities.pdf (1.99 Mo) Télécharger le fichier
Origin : Explicit agreement for this submission

Dates and versions

hal-03353572 , version 1 (24-09-2021)



Ruben Delgado-Escano, Francisco M Castro, Nicolas Guil, Vicky Kalogeiton, Manuel J Marin-Jimenez. Multimodal Gait Recognition Under Missing Modalities. 2021 IEEE International Conference on Image Processing (ICIP), Sep 2021, Anchorage, Alaska (virtual), United States. ⟨10.1109/ICIP42928.2021.9506162⟩. ⟨hal-03353572⟩
58 View
175 Download



Gmail Facebook X LinkedIn More