Multimodal processing of language

LEVERAGING LABEL CORRELATIONS IN A MULTI-LABEL SETTING: A CASE STUDY IN EMOTION

USING EMOTION EMBEDDINGS TO TRANSFER KNOWLEDGE BETWEEN EMOTIONS, LANGUAGES, AND ANNOTATION FORMATS

Exploring Attention Mechanisms for Multimodal Emotion Recognition in an Emergency Call Center Corpus

Articulation GAN: Unsupervised modeling of articulatory learning

Learning Cross-modal Audiovisual Representations with Ladder Networks for Emotion Recognition

PREFIX TUNING FOR AUTOMATED AUDIO CAPTIONING

M2-CTTS: End-to-End Multi-scale Multi-modal Conversational Text-to-Speech Synthesis

Toward a Multimodal Approach for Disfluency Detection and Categorization

Cross-Modal Audio-Visual Co-learning for Text-independent Speaker Verification

Multi-Scale Receptive Field Graph Model for Emotion Recognition in Conversations

LA-VocE: Low-SNR Audio-visual Speech Enhancement using Neural Vocoders

Auxiliary Pooling Layer For Spoken Language Understanding