Citation

Macarulla Rodriguez A, Geradts Z, Worring M, Unzueta L. Forensic Sci. Int. Synergy 2024; 8: e100458.

Copyright

(Copyright © 2024, Elsevier Publishing)

DOI

10.1016/j.fsisyn.2024.100458

PMID

unavailable

Abstract

In forensic and security scenarios, accurate facial recognition in surveillance videos, often challenged by variations in pose, illumination, and expression, is essential. Traditional manual comparison methods lack standardization, revealing a critical gap in evidence reliability. We propose an enhanced images-to-video recognition approach, pairing facial images with attributes like pose and quality. Utilizing datasets such as ENFSI 2015, SCFace, XQLFW, ChokePoint, and ForenFace, we assess evidence strength using calibration methods for likelihood ratio estimation. Three models--ArcFace, FaceNet, and QMagFace--undergo validation, with the log-likelihood ratio cost (Cllr) as a key metric.

RESULTS indicate that prioritizing high-quality frames and aligning attributes with reference images optimizes recognition, yielding similar Cllr values to the top 25% best frames approach. A combined embedding weighted by frame quality emerges as the second-best method. Upon preprocessing facial images with the super resolution CodeFormer, it unexpectedly increased Cllr, undermining evidence reliability, advising against its use in such forensic applications.

Language: en

Keywords

Face image quality; Face recognition; Likelihood ratio; Multi-modal analysis; Super resolution; Video processing