English
Related papers

Related papers: Can Large Vision-Language Models Understand Multim…

200 papers

Multimodal sarcasm detection (MSD) aims to identify sarcasm within image-text pairs by modeling semantic incongruities across modalities. Existing methods often exploit cross-modal embedding misalignment to detect inconsistency but struggle…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Shuguang Zhang , Junhong Lian , Guoxin Yu , Baoxun Xu , Xiang Ao

Sarcasm detection identifies natural language expressions whose intended meaning is different from what is implied by its surface meaning. It finds applications in many NLP tasks such as opinion mining, sentiment analysis, etc. Today,…

Multimedia · Computer Science 2021-10-04 Sundesh Gupta , Aditya Shah , Miten Shah , Laribok Syiemlieh , Chandresh Maurya

Large language models (LLMs) have shown remarkable ability in various language tasks, especially with their emergent in-context learning capability. Extending LLMs to incorporate visual inputs, large vision-language models (LVLMs) have…

Machine Learning · Computer Science 2025-10-13 Aneesh Komanduri , Karuna Bhaila , Xintao Wu

Sarcasm is often expressed through several verbal and non-verbal cues, e.g., a change of tone, overemphasis in a word, a drawn-out syllable, or a straight looking face. Most of the recent work in sarcasm detection has been carried out on…

Computation and Language · Computer Science 2019-06-06 Santiago Castro , Devamanyu Hazarika , Verónica Pérez-Rosas , Roger Zimmermann , Rada Mihalcea , Soujanya Poria

Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in processing both visual and textual information. However, the critical challenge of alignment between visual and textual representations is not fully…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Dong Shu , Haiyan Zhao , Jingyu Hu , Weiru Liu , Ali Payani , Lu Cheng , Mengnan Du

Various linguistic and non-linguistic clues, such as excessive emphasis on a word, a shift in the tone of voice, or an awkward expression, frequently convey sarcasm. The computer vision problem of sarcasm recognition in conversation aims to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Ananya Pandey , Dinesh Kumar Vishwakarma

Predicting context-dependent and non-literal utterances like sarcastic and ironic expressions still remains a challenging task in NLP, as it goes beyond linguistic patterns, encompassing common sense and shared knowledge as crucial…

Computation and Language · Computer Science 2018-09-27 Suzana Ilić , Edison Marrese-Taylor , Jorge A. Balazs , Yutaka Matsuo

With the advent of Large Language Models (LLMs) possessing increasingly impressive capabilities, a number of Large Vision-Language Models (LVLMs) have been proposed to augment LLMs with visual inputs. Such models condition generated text on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Phillip Howard , Kathleen C. Fraser , Anahita Bhiwandiwalla , Svetlana Kiritchenko

Sarcasm is a linguistic expression often used to communicate the opposite of what is said, usually something that is very unpleasant with an intention to insult or ridicule. Inherent ambiguity in sarcastic expressions, make sarcasm…

Computation and Language · Computer Science 2021-04-07 Ramya Akula , Ivan Garibay

The development of Large Vision-Language Models (LVLMs) is striving to catch up with the success of Large Language Models (LLMs), yet it faces more challenges to be resolved. Very recent works enable LVLMs to localize object-level visual…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Zhipeng Huang , Zhizheng Zhang , Zheng-Jun Zha , Yan Lu , Baining Guo

There has been growing interest in Multimodal Aspect-Based Sentiment Analysis (MABSA) in recent years. Existing methods predominantly rely on pre-trained small language models (SLMs) to collect information related to aspects and sentiments…

Computation and Language · Computer Science 2025-05-27 Jun Cao , Jiyi Li , Ziwei Yang , Renjie Zhou

Recognizing sarcasm often requires a deep understanding of multiple sources of information, including the utterance, the conversational context, and real world facts. Most of the current sarcasm detection systems consider only the utterance…

Computation and Language · Computer Science 2018-09-11 Reza Ghaeini , Xiaoli Z. Fern , Prasad Tadepalli

Multimodal sarcasm detection (MSD) is essential for various downstream tasks. Existing MSD methods tend to rely on spurious correlations. These methods often mistakenly prioritize non-essential features yet still make correct predictions,…

Computation and Language · Computer Science 2024-12-10 Diandian Guo , Cong Cao , Fangfang Yuan , Yanbing Liu , Guangjie Zeng , Xiaoyan Yu , Hao Peng , Philip S. Yu

Subjective language understanding refers to a broad set of natural language processing tasks where the goal is to interpret or generate content that conveys personal feelings, opinions, or figurative meanings rather than objective facts.…

Computation and Language · Computer Science 2025-08-12 Changhao Song , Yazhou Zhang , Hui Gao , Ben Yao , Peng Zhang

Multimodal language analysis is a rapidly evolving field that leverages multiple modalities to enhance the understanding of high-level semantics underlying human conversational utterances. Despite its significance, little research has…

Computation and Language · Computer Science 2025-04-25 Hanlei Zhang , Zhuohang Li , Yeshuang Zhu , Hua Xu , Peiwu Wang , Haige Zhu , Jie Zhou , Jinchao Zhang

Sarcasm is a nuanced and often misinterpreted form of communication, especially in text, where tone and body language are absent. This paper proposes a modular deep learning framework for sarcasm detection, leveraging Deep Convolutional…

Computation and Language · Computer Science 2025-10-14 Manas Zambre , Sarika Bobade

Sarcasm is a form of figurative language where the intended meaning of a sentence differs from its literal meaning. This poses a serious challenge to several Natural Language Processing (NLP) applications such as Sentiment Analysis, Opinion…

Computation and Language · Computer Science 2022-06-20 Abdelkader El Mahdaouy , Abdellah El Mekki , Kabil Essefar , Abderrahman Skiredj , Ismail Berrada

Sarcasm, a common feature of human communication, poses challenges in interpersonal interactions and human-machine interactions. Linguistic research has highlighted the importance of prosodic cues, such as variations in pitch, speaking…

Computation and Language · Computer Science 2025-09-08 Xiyuan Gao , Shekhar Nayak , Matt Coler

Sentiment classification and sarcasm detection are both important natural language processing (NLP) tasks. Sentiment is always coupled with sarcasm where intensive emotion is expressed. Nevertheless, most literature considers them as two…

Computation and Language · Computer Science 2019-03-12 Navonil Majumder , Soujanya Poria , Haiyun Peng , Niyati Chhaya , Erik Cambria , Alexander Gelbukh

Compared to traditional sentiment analysis, which only considers text, multimodal sentiment analysis needs to consider emotional signals from multimodal sources simultaneously and is therefore more consistent with the way how humans process…

Computation and Language · Computer Science 2024-08-19 Hao Yang , Yanyan Zhao , Yang Wu , Shilong Wang , Tian Zheng , Hongbo Zhang , Zongyang Ma , Wanxiang Che , Bing Qin