English
Related papers

Related papers: Debiasing Multimodal Sarcasm Detection with Contra…

200 papers

Current techniques for detecting AI-generated text are largely confined to manual feature crafting and supervised binary classification paradigms. These methodologies typically lead to performance bottlenecks and unsatisfactory…

Computation and Language · Computer Science 2024-10-29 Xun Guo , Shan Zhang , Yongxin He , Ting Zhang , Wanquan Feng , Haibin Huang , Chongyang Ma

Classifying samples as in-distribution or out-of-distribution (OOD) is a challenging problem of anomaly detection and a strong test of the generalisation power for models of the in-distribution. In this paper, we present a simple and…

Machine Learning · Computer Science 2021-03-29 Nima Rafiee , Rahil Gholamipoor , Markus Kollmann

Detecting out of distribution (OOD) samples is of paramount importance in all Machine Learning applications. Deep generative modeling has emerged as a dominant paradigm to model complex data distributions without labels. However, prior work…

Machine Learning · Computer Science 2021-01-05 Gowthami Somepalli , Yexin Wu , Yogesh Balaji , Bhanukiran Vinzamuri , Soheil Feizi

Supervised learning aims to train a classifier under the assumption that training and test data are from the same distribution. To ease the above assumption, researchers have studied a more realistic setting: out-of-distribution (OOD)…

Machine Learning · Computer Science 2023-02-28 Zhen Fang , Yixuan Li , Jie Lu , Jiahua Dong , Bo Han , Feng Liu

Recent advances in robust semi-supervised learning (SSL) typically filter out-of-distribution (OOD) information at the sample level. We argue that an overlooked problem of robust SSL is its corrupted information on semantic level,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Yu Wang , Pengchong Qiao , Chang Liu , Guoli Song , Xiawu Zheng , Jie Chen

Multimodal intent understanding is a significant research area that requires effective leveraging of multiple modalities to analyze human language. Existing methods face two main challenges in this domain. Firstly, they have limitations in…

Multimedia · Computer Science 2025-05-26 Hanlei Zhang , Qianrui Zhou , Hua Xu , Jianhua Su , Roberto Evans , Kai Gao

Multimodal learning aims to imitate human beings to acquire complementary information from multiple modalities for various downstream tasks. However, traditional aggregation-based multimodal fusion methods ignore the inter-modality…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Heqing Zou , Meng Shen , Chen Chen , Yuchen Hu , Deepu Rajan , Eng Siong Chng

Contrastive learning is commonly used as a method of self-supervised learning with the "anchor" and "positive" being two random augmentations of a given input image, and the "negative" is the set of all other images. However, the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Rishab Balasubramanian , Kunal Rathore

Machine learning methods must be trusted to make appropriate decisions in real-world environments, even when faced with out-of-distribution (OOD) samples. Many current approaches simply aim to detect OOD examples and alert the user when an…

Machine Learning · Computer Science 2022-09-13 Randolph Linderman , Jingyang Zhang , Nathan Inkawhich , Hai Li , Yiran Chen

Unsupervised aspect detection (UAD) aims at automatically extracting interpretable aspects and identifying aspect-specific segments (such as sentences) from online reviews. However, recent deep learning-based topic models, specifically…

Computation and Language · Computer Science 2021-01-01 Tian Shi , Liuqing Li , Ping Wang , Chandan K. Reddy

Sarcasm is a peculiar form of sentiment expression, where the surface sentiment differs from the implied sentiment. The detection of sarcasm in social media platforms has been applied in the past mainly to textual utterances where lexical…

Computer Vision and Pattern Recognition · Computer Science 2016-08-09 Rossano Schifanella , Paloma de Juan , Joel Tetreault , Liangliang Cao

Contrastive learning is a family of self-supervised methods where a model is trained to solve a classification task constructed from unlabeled data. It has recently emerged as one of the leading learning paradigms in the absence of labels…

Machine Learning · Statistics 2021-03-05 Bingbin Liu , Pradeep Ravikumar , Andrej Risteski

Sarcasm detection remains a challenge in natural language understanding, as sarcastic intent often relies on subtle cross-modal cues spanning text, speech, and vision. While prior work has primarily focused on textual or visual-textual…

Computation and Language · Computer Science 2025-09-22 Zhu Li , Xiyuan Gao , Yuqing Zhang , Shekhar Nayak , Matt Coler

Speech models may be affected by performance imbalance in different population subgroups, raising concerns about fair treatment across these groups. Prior attempts to mitigate unfairness either focus on user-defined subgroups, potentially…

Computation and Language · Computer Science 2024-09-17 Alkis Koudounas , Flavio Giobergia , Eliana Pastor , Elena Baralis

Out-of-distribution (OOD) detection, i.e., finding test samples derived from a different distribution than the training set, as well as reasoning about such samples (OOD reasoning), are necessary to ensure the safety of results generated by…

Machine Learning · Computer Science 2022-10-19 Zahra Rahiminasab , Michael Yuhas , Arvind Easwaran

Out-of-distribution (OOD) detection empowers the model trained on the closed image set to identify unknown data in the open world. Though many prior techniques have yielded considerable improvements in this research direction, two crucial…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Sen Pei

Contrastive representation learning has gained much attention due to its superior performance in learning representations from both image and sequential data. However, the learned representations could potentially lead to performance…

Computation and Language · Computer Science 2022-11-01 Jianfeng Chi , William Shand , Yaodong Yu , Kai-Wei Chang , Han Zhao , Yuan Tian

Multimodal respiratory sound classification offers promise for early pulmonary disease detection by integrating bioacoustic signals with patient metadata. Nevertheless, current approaches remain vulnerable to spurious correlations from…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-28 Heejoon Koo , Miika Toikkanen , Yoon Tae Kim , Soo Yong Kim , June-Woo Kim

Learning semantically meaningful sentence embeddings is an open problem in natural language processing. In this work, we propose a sentence embedding learning approach that exploits both visual and textual information via a multimodal…

Computation and Language · Computer Science 2022-04-26 Miaoran Zhang , Marius Mosbach , David Ifeoluwa Adelani , Michael A. Hedderich , Dietrich Klakow

Learning multi-label image recognition with incomplete annotation is gaining popularity due to its superior performance and significant labor savings when compared to training with fully labeled datasets. Existing literature mainly focuses…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Cheng Chen , Yifan Zhao , Jia Li