Coopnet: Multi-Modal Cooperative Gender Prediction In Social Media User Profiling
Lin Li, Kaixi Hu, Yunpei Zheng, Jianquan Liu, Kong Aik Lee
-
SPS
IEEE Members: $11.00
Non-members: $15.00Length: 00:08:42
The principal way of performing user profiling is to investigate accumulated social media data. However, the problem of information asymmetry generally exists in user generated contents since users post multi-modal contents in social media freely. In this paper, we propose a novel text-image cooperation framework (COOPNet), a bridge connection network architecture that exchanges information between texts and images. First, we map the representations of both visual and sentiment enriched textual modalities into a cooperative semantic space to derive a cooperative representation. Next, the representations of texts and images are combined with their cooperative representation to exchange knowledge in the learning process. Finally, a multi-modal regression is leveraged to make cooperative decisions. Extensive experiments on the public PAN-2018 dataset demonstrate the efficacy of our framework over the state-of-the-art methods on the premise of automatic feature learning.
Chairs:
Chaker Larabi