FUSION-ID: A PHOTOPLETHYSMOGRAPHY AND MOTION SENSOR FUSION BIOMETRIC AUTHENTICATOR WITH FEW-SHOT ON-BOARDING

The abundance of wrist-worn heart rate measuring devices enables long term cardiovascular monitoring through photoplethysmography (PPG). Such signals contain unique identifiable information that can help in biometric authentication. In this work, we propose Fusion-ID, which use wrist-worn PPG sensors fused with motion sensor data as a way to do bio authentication on wrist worn devices. We conducted a user study using a PPG and motion sensor enabled wrist-worn device and collected data from 247 users. We then propose a novel sensor fusion deep Siamese network architecture for feature embedding. Specifically, Fusion-ID fuses information from multiple channels of PPG readings with information from motion sensors to authenticate a user. Our architecture only needs a few seconds of sample data (shots) from new users, and it is the first PPG-based bio-authentication method that is capable of adapting to new users without requiring on-device training or fine-tuning of the model. Our evaluations confirm the effectiveness of proposed siamese network with sensor fusion with an average accuracy of 95% and 12% false rejection rate at the 1% false acceptance rate operating point.