Conference proceeding
FarSight: A Physics-Driven Whole-Body Biometric System at Large Distance and Altitude
2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), pp 6215-6224
03 Jan 2024
Abstract
Whole-body biometric recognition is an important area of research due to its vast applications in law enforcement, border security, and surveillance. This paper presents the end-to-end design, development and evaluation of FarSight, an innovative software system designed for whole-body (fusion of face, gait and body shape) biometric recognition. FarSight accepts videos from elevated platforms and drones as input and outputs a candidate list of identities from a gallery. The system is designed to address several challenges, including (i) low-quality imagery, (ii) large yaw and pitch angles, (iii) robust feature extraction to accommodate large intra-person variabilities and large inter-person similarities, and (iv) the large domain gap between training and test sets. FarSight combines the physics of imaging and deep learning models to enhance image restoration and biometric feature encoding. We test FarSight's effectiveness using the newly acquired IARPA Biometric Recognition and Identification at Altitude and Range (BRIAR) dataset. Notably, FarSight demonstrated a substantial performance increase on the BRIAR dataset, with gains of +11.82% Rank-20 identification and +11.30% TAR@1% FAR.
Metrics
22 Record Views
5 citations in Scopus
Details
- Title
- FarSight: A Physics-Driven Whole-Body Biometric System at Large Distance and Altitude
- Creators
- Feng Liu - Drexel University, Computer ScienceRyan Ashbaugh - Michigan State UniversityNicholas Chimitt - Purdue University West LafayetteNajmul Hassan - University of OregonAli Hassani - Georgia Institute of TechnologyAjay Jaiswal - University of Texas at Austin,Austin,TX,USA,78712Minchul Kim - Michigan State UniversityZhiyuan Mao - Purdue University West LafayetteChristopher Perry - Michigan State UniversityZhiyuan Ren - Michigan State UniversityYiyang Su - Michigan State UniversityPegah Varghaei - Michigan State UniversityKai Wang - Georgia Institute of TechnologyStanley Chan - Purdue University West LafayetteArun Ross - Michigan State UniversityHumphrey Shi - Georgia Institute of TechnologyZhangyang Wang - University of Texas at Austin,Austin,TX,USA,78712Anil Jain - Michigan State UniversityXiaoming Liu - Michigan State University
- Publication Details
- 2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), pp 6215-6224
- Publisher
- IEEE
- Number of pages
- 10
- Grant note
- Office of the Director of National Intelligence (10.13039/100011038) Intelligence Advanced Research Projects Activity (10.13039/100011039)
- Resource Type
- Conference proceeding
- Language
- English
- Academic Unit
- Computer Science
- Scopus ID
- 2-s2.0-85189782028
- Other Identifier
- 991022008296104721