English
Related papers

Related papers: Zero-Shot Cross-Lingual Sentiment Classification u…

200 papers

While pretrained language models have exhibited impressive generalization capabilities, they still behave unpredictably under certain domain shifts. In particular, a model may learn a reasoning process on in-domain training data that does…

Computation and Language · Computer Science 2022-10-14 Prasann Singhal , Jarad Forristal , Xi Ye , Greg Durrett

Improving out-of-distribution (OOD) generalization during in-distribution (ID) adaptation is a primary goal of robust fine-tuning of zero-shot models beyond naive fine-tuning. However, despite decent OOD generalization performance from…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Changdae Oh , Hyesu Lim , Mijoo Kim , Dongyoon Han , Sangdoo Yun , Jaegul Choo , Alexander Hauptmann , Zhi-Qi Cheng , Kyungwoo Song

Counterfactually-Augmented Data (CAD) -- minimal editing of sentences to flip the corresponding labels -- has the potential to improve the Out-Of-Distribution (OOD) generalization capability of language models, as CAD induces language…

Computation and Language · Computer Science 2023-10-11 Caoyun Fan , Wenqing Chen , Jidong Tian , Yitian Li , Hao He , Yaohui Jin

Out-of-distribution (OOD) detection has seen significant advancements with zero-shot approaches by leveraging the powerful Vision-Language Models (VLMs) such as CLIP. However, prior research works have predominantly focused on enhancing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Pei-Kang Lee , Jun-Cheng Chen , Ja-Ling Wu

A large language model's (LLM's) out-of-distribution (OOD) generalisation ability is crucial to its deployment. Previous work assessing LLMs' generalisation performance, however, typically focuses on a single out-of-distribution dataset.…

Computation and Language · Computer Science 2025-12-09 Matteo Boglioni , Andrea Sgobbi , Gabriel Tavernini , Francesco Rita , Marius Mosbach , Tiago Pimentel

We focus on the challenge of out-of-distribution (OOD) detection in deep learning models, a crucial aspect in ensuring reliability. Despite considerable effort, the problem remains significantly challenging in deep learning models due to…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Yunhao Ge , Jie Ren , Jiaping Zhao , Kaifeng Chen , Andrew Gallagher , Laurent Itti , Balaji Lakshminarayanan

Counterfactually-Augmented Data (CAD) has the potential to improve language models' Out-Of-Distribution (OOD) generalization capability, as CAD induces language models to exploit causal features and exclude spurious correlations. However,…

Computation and Language · Computer Science 2023-02-21 Caoyun Fan , Wenqing Chen , Jidong Tian , Yitian Li , Hao He , Yaohui Jin

How can models effectively detect out-of-distribution (OOD) samples in complex, multi-label settings without extensive retraining? Existing OOD detection methods struggle to capture the intricate semantic relationships and label…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Zhendong Liu , Yi Nian , Yuehan Qin , Henry Peng Zou , Li Li , Xiyang Hu , Yue Zhao

Out-of-Distribution (OOD) generalization, a cornerstone for building robust machine learning models capable of handling data diverging from the training set's distribution, is an ongoing challenge in deep learning. While significant…

Machine Learning · Computer Science 2023-12-05 Sergey Kolesnikov

Recent large vision-language models such as CLIP have shown remarkable out-of-distribution (OOD) detection and generalization performance. However, their zero-shot in-distribution (ID) accuracy is often limited for downstream datasets.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Yifei Ming , Yixuan Li

While pretrained language models achieve excellent performance on natural language understanding benchmarks, they tend to rely on spurious correlations and generalize poorly to out-of-distribution (OOD) data. Recent work has explored using…

Computation and Language · Computer Science 2022-03-17 Nitish Joshi , He He

Recognizing out-of-distribution (OOD) samples is critical for machine learning systems deployed in the open world. The vast majority of OOD detection methods are driven by a single modality (e.g., either vision or language), leaving the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Yifei Ming , Ziyang Cai , Jiuxiang Gu , Yiyou Sun , Wei Li , Yixuan Li

We propose a generalized method for boosting the generalization ability of pre-trained vision-language models (VLMs) while fine-tuning on downstream few-shot tasks. The idea is realized by exploiting out-of-distribution (OOD) detection to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Kun Ding , Haojian Zhang , Qiang Yu , Ying Wang , Shiming Xiang , Chunhong Pan

Despite commendable achievements made by existing work, prevailing multimodal sarcasm detection studies rely more on textual content over visual information. It unavoidably induces spurious correlations between textual words and labels,…

Computation and Language · Computer Science 2023-12-20 Mengzhao Jia , Can Xie , Liqiang Jing

Out-of-distribution (OOD) testing is increasingly popular for evaluating a machine learning system's ability to generalize beyond the biases of a training set. OOD benchmarks are designed to present a different joint distribution of data…

Computer Vision and Pattern Recognition · Computer Science 2020-05-20 Damien Teney , Kushal Kafle , Robik Shrestha , Ehsan Abbasnejad , Christopher Kanan , Anton van den Hengel

Test data is said to be out-of-distribution (OOD) when it unexpectedly differs from the training data, a common challenge in real-world use cases of machine learning. Although OOD generalisation has gained interest in recent years, few…

Computation and Language · Computer Science 2024-09-30 Dejan Porjazovski , Anssi Moisio , Mikko Kurimo

Out-of-distribution (OOD) generalization, where the model needs to handle distribution shifts from training, is a major challenge of machine learning. Contrastive language-image pre-training (CLIP) models have shown impressive zero-shot…

Machine Learning · Computer Science 2023-07-17 Yang Shu , Xingzhuo Guo , Jialong Wu , Ximei Wang , Jianmin Wang , Mingsheng Long

Out-of-distribution (OOD) detection, which maps high-dimensional data into a scalar OOD score, is critical for the reliable deployment of machine learning models. A key challenge in recent research is how to effectively leverage and…

Machine Learning · Computer Science 2026-02-06 Claus Hofmann , Christian Huber , Bernhard Lehner , Daniel Klotz , Sepp Hochreiter , Werner Zellinger

Real-world machine learning applications often face simultaneous covariate and semantic shifts, challenging traditional domain generalization and out-of-distribution (OOD) detection methods. We introduce Meta-learned Across Domain…

Machine Learning · Computer Science 2024-11-06 Haoliang Wang , Chen Zhao , Feng Chen

Traditional machine learning paradigms are based on the assumption that both training and test data follow the same statistical pattern, which is mathematically referred to as Independent and Identically Distributed ($i.i.d.$). However, in…

Machine Learning · Computer Science 2023-07-28 Jiashuo Liu , Zheyan Shen , Yue He , Xingxuan Zhang , Renzhe Xu , Han Yu , Peng Cui
‹ Prev 1 2 3 10 Next ›