English
Related papers

Related papers: Multi-Modal Sarcasm Detection Based on Contrastive…

200 papers

Since their inception, transformer-based language models have led to impressive performance gains across multiple natural language processing tasks. For Arabic, the current state-of-the-art results on most datasets are achieved by the…

Computation and Language · Computer Science 2021-03-11 Amey Hengle , Atharva Kshirsagar , Shaily Desai , Manisha Marathe

Automatic detection of multimodal fake news has gained a widespread attention recently. Many existing approaches seek to fuse unimodal features to produce multimodal news representations. However, the potential of powerful cross-modal…

Machine Learning · Computer Science 2023-08-14 Longzheng Wang , Chuang Zhang , Hongbo Xu , Yongxiu Xu , Xiaohan Xu , Siqi Wang

Cross-modal attention mechanisms have been widely applied to the image-text matching task and have achieved remarkable improvements thanks to its capability of learning fine-grained relevance across different modalities. However, the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Yuxiao Chen , Jianbo Yuan , Long Zhao , Tianlang Chen , Rui Luo , Larry Davis , Dimitris N. Metaxas

Sarcasm is a form of figurative language where the intended meaning of a sentence differs from its literal meaning. This poses a serious challenge to several Natural Language Processing (NLP) applications such as Sentiment Analysis, Opinion…

Computation and Language · Computer Science 2022-06-20 Abdelkader El Mahdaouy , Abdellah El Mekki , Kabil Essefar , Abderrahman Skiredj , Ismail Berrada

The rapid proliferation of multimodal social media content has driven research in Multimodal Conversational Stance Detection (MCSD), which aims to interpret users' attitudes toward specific targets within complex discussions. However,…

Computation and Language · Computer Science 2026-03-11 Bingbing Wang , Zhixin Bai , Zhengda Jin , Zihan Wang , Xintong Song , Jingjie Lin , Sixuan Li , Jing Li , Ruifeng Xu

Modality representation learning is an important problem for multimodal sentiment analysis (MSA), since the highly distinguishable representations can contribute to improving the analysis effect. Previous works of MSA have usually focused…

Multimedia · Computer Science 2023-01-31 Peipei Liu , Xin Zheng , Hong Li , Jie Liu , Yimo Ren , Hongsong Zhu , Limin Sun

Human emotions are complex, with sarcasm being a subtle and distinctive form. Despite progress in sarcasm research, sarcasm generation remains underexplored, primarily due to the overreliance on textual modalities and the neglect of visual…

Computation and Language · Computer Science 2025-07-15 Changli Wang , Rui Wu , Fang Yin

Speech emotion recognition is a challenge and an important step towards more natural human-computer interaction (HCI). The popular approach is multimodal emotion recognition based on model-level fusion, which means that the multimodal…

Sound · Computer Science 2022-11-22 Fan Qian , Jiqing Han

Condescending language use is caustic; it can bring dialogues to an end and bifurcate communities. Thus, systems for condescension detection could have a large positive impact. A challenge here is that condescension is often impossible to…

Computation and Language · Computer Science 2019-09-26 Zijian Wang , Christopher Potts

Contrastive learning has been successfully used for retrieval of semantically aligned sentences, but it often requires large batch sizes or careful engineering to work well. In this paper, we instead propose a generative model for learning…

Computation and Language · Computer Science 2023-06-06 John Wieting , Jonathan H. Clark , William W. Cohen , Graham Neubig , Taylor Berg-Kirkpatrick

Sarcasm is a challenge to sentiment analysis because of the incongruity between stated and implied sentiment. The challenge is exacerbated when the implication may be relevant to a specific country or geographical region. Pragmatic…

Computation and Language · Computer Science 2025-10-31 Ishmanbir Singh , Dipankar Srirag , Aditya Joshi

Sentiments expressed in user-generated short text and sentences are nuanced by subtleties at lexical, syntactic, semantic and pragmatic levels. To address this, we propose to augment traditional features used for sentiment analysis and…

Computation and Language · Computer Science 2017-01-23 Abhijit Mishra , Diptesh Kanojia , Seema Nagar , Kuntal Dey , Pushpak Bhattacharyya

We address the challenge of detecting questionable content in online media, specifically the subcategory of comic mischief. This type of content combines elements such as violence, adult content, or sarcasm with humor, making it difficult…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Elaheh Baharlouei , Mahsa Shafaei , Yigeng Zhang , Hugo Jair Escalante , Thamar Solorio

Large Language Models (LLMs) frequently show distracted attention due to irrelevant information in the input, which severely impairs their long-context capabilities. Inspired by recent studies on the effectiveness of retrieval heads in…

Computation and Language · Computer Science 2025-02-20 Weihao Liu , Ning Wu , Shiping Yang , Wenbiao Ding , Shining Liang , Ming Gong , Dongmei Zhang

The existence of multiple datasets for sarcasm detection prompts us to apply transfer learning to exploit their commonality. The adversarial neural transfer (ANT) framework utilizes multiple loss terms that encourage the source-domain and…

Machine Learning · Computer Science 2021-08-17 Xu Guo , Boyang Li , Han Yu , Chunyan Miao

As one of the most intuitive interfaces known to humans, natural language has the potential to mediate many tasks that involve human-computer interaction, especially in application-focused fields like Music Information Retrieval. In this…

Sound · Computer Science 2022-08-26 Ilaria Manco , Emmanouil Benetos , Elio Quinton , György Fazekas

The rapid rise of deepfake technology poses a severe threat to social and political stability by enabling hyper-realistic synthetic media capable of manipulating public perception. However, existing detection methods struggle with two core…

Computation and Language · Computer Science 2026-01-27 Gautam Siddharth Kashyap , Harsh Joshi , Niharika Jain , Ebad Shabbir , Jiechao Gao , Nipun Joshi , Usman Naseem

Advances in computer vision and deep learning have blurred the line between deepfakes and authentic media, undermining multimedia credibility through audio-visual forgery. Current multimodal detection methods remain limited by unbalanced…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Zihan Xiong , Xiaohua Wu , Lei Chen , Fangqi Lou

Video captioning aims to describe video contents using natural language format that involves understanding and interpreting scenes, actions and events that occurs simultaneously on the view. Current approaches have mainly concentrated on…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Antoine Hanna-Asaad , Decky Aspandi , Titus Zaharia

Measuring the congruence between two texts has several useful applications, such as detecting the prevalent deceptive and misleading news headlines on the web. Many works have proposed machine learning based solutions such as text…

Computation and Language · Computer Science 2020-10-09 Rahul Mishra , Piyush Yadav , Remi Calizzano , Markus Leippold