Robust multi-faces recognition and tracking via fuzzy genetic algorithms and deep coupled features

Abstract

In real-world surveillance environments, face recognition and tracking remain challenging due to partial occlusion, pose variation, illumination changes, and background clutter. This paper presents a robust hybrid framework that integrates fuzzy genetic algorithms (FGA) with deep coupled feature learning for multi-face recognition and tracking. The proposed system comprises three main modules: i) face detection and pre processing using the multi-task cascaded convolutional network (MTCNN), ii) deep coupled ResNet embeddings that jointly learn identity and appearance-invariant representations, and iii) a fuzzy rule-based genetic optimizer that adaptively refines tracking decisions based on uncertainty in motion, appearance similarity, and occlusion levels. The novelty of this work lies in the fusion of fuzzy inference with evolutionary search to guide the genetic optimization process—allowing dynamic adaptation to noisy and uncertain visual conditions. Moreover, probabilistic data association filters (PDAF) and conditional joint likelihood filters (CJLF) are employed to further enhance temporal consistency under occlusion and appearance variation. The results confirm that fuzzy evolutionary optimization, when coupled with deep feature learning, significantly improves robustness and stability for real-time face tracking in complex, dynamic scenes.