English
Related papers

Related papers: URMF: Uncertainty-aware Robust Multimodal Fusion f…

200 papers

Multimodal sarcasm detection, which aims to precisely identify pragmatic incongruities between literal text and nonverbal cues, has gained substantial attention in multimodal understanding. Recent advancements have predominantly relied on…

Computation and Language · Computer Science 2026-05-05 Maoheng Li , Ling Zhou , Xiaohua Huang , Rubing Huang , Wenming Zheng , Guoying Zhao

Sarcasm typically conveys emotions of contempt or criticism by expressing a meaning that is contrary to the speaker's true intent. Accurate detection of sarcasm aids in identifying and filtering undesirable information on the Internet,…

Computation and Language · Computer Science 2024-12-18 Tongguan Wang , Junkai Li , Guixin Su , Yongcheng Zhang , Dongyu Su , Yuxue Hu , Ying Sha

Sarcasm is a rhetorical device that is used to convey the opposite of the literal meaning of an utterance. Sarcasm is widely used on social media and other forms of computer-mediated communication motivating the use of computational models…

Computation and Language · Computer Science 2024-10-25 Shafkat Farabi , Tharindu Ranasinghe , Diptesh Kanojia , Yu Kong , Marcos Zampieri

Multimodal sarcasm detection (MSD) aims to identify sarcasm within image-text pairs by modeling semantic incongruities across modalities. Existing methods often exploit cross-modal embedding misalignment to detect inconsistency but struggle…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Shuguang Zhang , Junhong Lian , Guoxin Yu , Baoxun Xu , Xiang Ao

The prevalence of sarcasm in multimodal dialogues on the social platforms presents a crucial yet challenging task for understanding the true intent behind online content. Comprehensive sarcasm analysis requires two key aspects: Multimodal…

Computation and Language · Computer Science 2026-03-31 Diandian Guo , Fangfang Yuan , Cong Cao , Xixun Lin , Chuan Zhou , Hao Peng , Yanan Cao , Yanbing Liu

Multimodal sarcasm detection (MSD) is essential for various downstream tasks. Existing MSD methods tend to rely on spurious correlations. These methods often mistakenly prioritize non-essential features yet still make correct predictions,…

Computation and Language · Computer Science 2024-12-10 Diandian Guo , Cong Cao , Fangfang Yuan , Yanbing Liu , Guangjie Zeng , Xiaoyan Yu , Hao Peng , Philip S. Yu

Despite progress in multimodal sarcasm detection, existing datasets and methods predominantly focus on single-image scenarios, overlooking potential semantic and affective relations across multiple images. This leaves a gap in modeling…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Haochen Zhao , Yuyao Kong , Yongxiu Xu , Gaopeng Gou , Hongbo Xu , Yubin Wang , Haoliang Zhang

Sarcasm is often expressed through several verbal and non-verbal cues, e.g., a change of tone, overemphasis in a word, a drawn-out syllable, or a straight looking face. Most of the recent work in sarcasm detection has been carried out on…

Computation and Language · Computer Science 2019-06-06 Santiago Castro , Devamanyu Hazarika , Verónica Pérez-Rosas , Roger Zimmermann , Rada Mihalcea , Soujanya Poria

Multimodal sarcasm detection is a complex task that requires distinguishing subtle complementary signals across modalities while filtering out irrelevant information. Many advanced methods rely on learning shortcuts from datasets rather…

Machine Learning · Computer Science 2025-11-18 Yihua Wang , Qi Jia , Cong Xu , Feiyu Chen , Yuhan Liu , Haotian Zhang , Liang Jin , Lu Liu , Zhichun Wang

In the past decade, sarcasm detection has been intensively conducted in a textual scenario. With the popularization of video communication, the analysis in multi-modal scenarios has received much attention in recent years. Therefore,…

Computation and Language · Computer Science 2021-10-01 Xiaoqiang Zhang , Ying Chen , Guangyuan Li

Sarcasm is a type of irony, characterized by an inherent mismatch between the literal interpretation and the intended connotation. Though sarcasm detection in text has been extensively studied, there are situations in which textual input…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Sajal Aggarwal , Ananya Pandey , Dinesh Kumar Vishwakarma

Sarcasm is a linguistic phenomenon indicating a discrepancy between literal meanings and implied intentions. Due to its sophisticated nature, it is usually challenging to be detected from the text itself. As a result, multi-modal sarcasm…

Computation and Language · Computer Science 2022-10-18 Hui Liu , Wenya Wang , Haoliang Li

Sarcasm detection remains a challenge in natural language understanding, as sarcastic intent often relies on subtle cross-modal cues spanning text, speech, and vision. While prior work has primarily focused on textual or visual-textual…

Computation and Language · Computer Science 2025-09-22 Zhu Li , Xiyuan Gao , Yuqing Zhang , Shekhar Nayak , Matt Coler

Sarcasm, a common feature of human communication, poses challenges in interpersonal interactions and human-machine interactions. Linguistic research has highlighted the importance of prosodic cues, such as variations in pitch, speaking…

Computation and Language · Computer Science 2025-09-08 Xiyuan Gao , Shekhar Nayak , Matt Coler

The rapid dissemination of rumors on social media highlights the urgent need for automatic detection methods to safeguard societal trust and stability. While existing multimodal rumor detection models primarily emphasize capturing…

Multimedia · Computer Science 2025-06-02 Zihao Yu , Xiang Li , Jing Zhang

Multimodal AI models are increasingly used in fields like healthcare, finance, and autonomous driving, where information is drawn from multiple sources or modalities such as images, texts, audios, videos. However, effectively managing…

Machine Learning · Computer Science 2025-05-16 Grigor Bezirganyan , Sana Sellami , Laure Berti-Équille , Sébastien Fournier

Sarcasm is a peculiar form of sentiment expression, where the surface sentiment differs from the implied sentiment. The detection of sarcasm in social media platforms has been applied in the past mainly to textual utterances where lexical…

Computer Vision and Pattern Recognition · Computer Science 2016-08-09 Rossano Schifanella , Paloma de Juan , Joel Tetreault , Liangliang Cao

Multimodal learning is an emerging yet challenging research area. In this paper, we deal with multimodal sarcasm and humor detection from conversational videos and image-text pairs. Being a fleeting action, which is reflected across the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Shraman Pramanick , Aniket Roy , Vishal M. Patel

Multimodal sarcasm detection requires resolving pragmatic incongruity across textual, acoustic, and visual cues through cross-modal reasoning. To enable robust sarcasm reasoning with foundation models, we propose SarcasmMiner, a…

Multimedia · Computer Science 2026-03-06 Zhu Li , Yongjian Chen , Huiyuan Lai , Xiyuan Gao , Shekhar Nayak , Matt Coler

Multi-modal sarcasm detection has attracted much recent attention. Nevertheless, the existing benchmark (MMSD) has some shortcomings that hinder the development of reliable multi-modal sarcasm detection system: (1) There are some spurious…

Computation and Language · Computer Science 2023-07-17 Libo Qin , Shijue Huang , Qiguang Chen , Chenran Cai , Yudi Zhang , Bin Liang , Wanxiang Che , Ruifeng Xu
‹ Prev 1 2 3 10 Next ›