Transformer And Node-Compressed Dnn Based Dual-Path System For Manipulated Face Detection
Zhengbo Luo, Sei-ichiro Kamata, Zitang Sun
-
SPS
IEEE Members: $11.00
Non-members: $15.00Length: 00:10:36
Deep neural networks (DNNs) have extensively promoted data generation development; the quality of these generated content has achieved an impressive new level. Therefore, manipulated content, especially facial manipulation, is a growing concern for online information legitimacy. Most current deep learning-based methods depend on local features sampled by convolutional kernels and lack of knowledge globally. To address the problem, we propose a dual-path pipeline using Neural Ordinary Differential Equations (NODE) based neural network and facial-feature biased transformer to deal with the visual content from a different view. Moreover, we adopt an attention guided augmentation based self-ensemble for more robust performance. Extensive experiments show that our system could surpass several state-of-the-art level approaches in terms of video-level accuracy and AUC with better interpretability.