Cross-Modal Representation Reconstruction For Zero-Shot Classification

Zero-shot learning (ZSL) aims to recognize novel classes without training samples through transferring knowledge from seen classes, based on the assumption that both the seen and unseen classes share a latent semantic space. Previous works either focus on directly learning various mapping functions between visual space and semantic space, or searching a latent common subspace to alleviate semantic gap between different modalities. However, few methods directly learn modality-invariant representations for ZSL. In this paper, we propose a Cross-Modal Representation Reconstruction (CMRR) framework to bridge the semantic gap between visual features and semantic attributes, as well as introducing a novel regularizer for automatically feature selection. Moreover, an iterative optimization process based on the ALM (Augmented Lagrangian Method) algorithm with the alternating direction strategy is developed to solve the proposed formulation. Extensive experiments on four benchmark datasets show the effectiveness of the proposed approach, and even the performance surpasses some deep learning based methods.