English
Related papers

Related papers: Should Bias be Eliminated? A General Framework to …

200 papers

Detecting and rejecting unknown out-of-distribution (OOD) samples is critical for deployed neural networks to void unreliable predictions. In real-world scenarios, however, the efficacy of existing OOD detection methods is often impeded by…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Kai Liu , Zhihang Fu , Sheng Jin , Chao Chen , Ze Chen , Rongxin Jiang , Fan Zhou , Yaowu Chen , Jieping Ye

When modeling dynamical systems from real-world data samples, the distribution of data often changes according to the environment in which they are captured, and the dynamics of the system itself vary from one environment to another.…

Machine Learning · Computer Science 2022-02-15 Yuan Yin , Ibrahim Ayed , Emmanuel de Bézenac , Nicolas Baskiotis , Patrick Gallinari

Graph Out-of-Distribution (OOD), requiring that models trained on biased data generalize to the unseen test data, has a massive of real-world applications. One of the most mainstream methods is to extract the invariant subgraph by aligning…

Machine Learning · Computer Science 2024-02-15 Xuexin Chen , Ruichu Cai , Kaitao Zheng , Zhifan Jiang , Zhengting Huang , Zhifeng Hao , Zijian Li

The discrepancy between in-distribution (ID) and out-of-distribution (OOD) samples can lead to \textit{distributional vulnerability} in deep neural networks, which can subsequently lead to high-confidence predictions for OOD samples. This…

Machine Learning · Computer Science 2023-10-03 Zhilin Zhao , Longbing Cao , Kun-Yu Lin

Optimization is widely used in statistics, and often efficiently delivers point estimates on useful spaces involving structural constraints or combinatorial structure. To quantify uncertainty, Gibbs posterior exponentiates the negative loss…

Methodology · Statistics 2025-07-23 Cheng Zeng , Eleni Dilma , Jason Xu , Leo L Duan

Several popular computer vision (CV) datasets, specifically employed for Object Detection (OD) in autonomous driving tasks exhibit biases due to a range of factors including weather and lighting conditions. These biases may impair a model's…

Computer Vision and Pattern Recognition · Computer Science 2023-01-05 Aboli Marathe , Rahee Walambe , Ketan Kotecha

Conversational agents are usually designed for closed-world environments. Unfortunately, users can behave unexpectedly. Based on the open-world environment, we often encounter the situation that the training and test data are sampled from…

Computation and Language · Computer Science 2022-04-25 Petr Lorenc , Tommaso Gargiani , Jan Pichl , Jakub Konrád , Petr Marek , Ondřej Kobza , Jan Šedivý

Statistical learning on biological data can be challenging due to confounding variables in sample collection and processing. Confounders can cause models to generalize poorly and result in inaccurate prediction performance metrics if models…

Machine Learning · Computer Science 2018-12-13 Tzu-Yu Liu , Ajay Kannan , Adam Drake , Marvin Bertin , Nathan Wan

Out-of-distribution (OOD) detection plays a crucial role in ensuring the safety and reliability of deep neural networks in various applications. While there has been a growing focus on OOD detection in visual data, the field of textual OOD…

Computation and Language · Computer Science 2024-04-10 Li-Ming Zhan , Bo Liu , Xiao-Ming Wu

In practice, and especially when training deep neural networks, visual recognition rules are often learned based on various sources of information. On the other hand, the recent deployment of facial recognition systems with uneven…

Computer Vision and Pattern Recognition · Computer Science 2022-11-02 Stephan Clémençon , Pierre Laforgue , Robin Vogel

As one of the most successful generative models, diffusion models have demonstrated remarkable efficacy in synthesizing high-quality images. These models learn the underlying high-dimensional data distribution in an unsupervised manner.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Min Hou , Yueying Wu , Chang Xu , Yu-Hao Huang , Chenxi Bai , Le Wu , Jiang Bian

Domain Generalization aims to develop models that can generalize to novel and unseen data distributions. In this work, we study how model architectures and pre-training objectives impact feature richness and propose a method to effectively…

Machine Learning · Computer Science 2025-04-30 Xavier Thomas , Deepti Ghadiyaram

Out-of-distribution (OOD) detection is critical to ensuring the reliability and safety of machine learning systems. For instance, in autonomous driving, we would like the driving system to issue an alert and hand over the control to humans…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Jingkang Yang , Kaiyang Zhou , Yixuan Li , Ziwei Liu

Graph machine learning has been extensively studied in both academia and industry. Although booming with a vast number of emerging methods and techniques, most of the literature is built on the in-distribution hypothesis, i.e., testing and…

Machine Learning · Computer Science 2023-01-02 Haoyang Li , Xin Wang , Ziwei Zhang , Wenwu Zhu

Due to the performance degradation of graph neural networks (GNNs) under distribution shifts, the work on out-of-distribution (OOD) generalization on graphs has received widespread attention. A novel perspective involves distinguishing…

Machine Learning · Computer Science 2024-06-04 Haoran Yang , Xiaobing Pei , Kai Yuan

Two prevalent types of distributional shifts in machine learning are the covariate shift (as observed across different domains) and the semantic shift (as seen across different classes). Traditional OOD detection techniques typically…

Artificial Intelligence · Computer Science 2023-09-20 Haoliang Wang , Chen Zhao , Yunhui Guo , Kai Jiang , Feng Chen

Graph Out-of-Distribution (OOD), requiring that models trained on biased data generalize to the unseen test data, has considerable real-world applications. One of the most mainstream methods is to extract the invariant subgraph by aligning…

Machine Learning · Computer Science 2024-07-23 Xuexin Chen , Ruichu Cai , Kaitao Zheng , Zhifan Jiang , Zhengting Huang , Zhifeng Hao , Zijian Li

Constructing a robust model that can effectively generalize to test samples under distribution shifts remains a significant challenge in the field of medical imaging. The foundational models for vision and language, pre-trained on extensive…

Distribution shifts between training and testing datasets significantly impair the model performance on graph learning. A commonly-taken causal view in graph invariant learning suggests that stable predictive features of graphs are causally…

Machine Learning · Computer Science 2025-12-10 Bohan Wang , Yurui Chang , Wei Jin , Lu Lin

Out-of-distribution (OOD) detection is a critical task for ensuring the reliability and safety of deep neural networks in real-world scenarios. Different from most previous OOD detection methods that focus on designing OOD scores or…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yao Zhu , YueFeng Chen , Chuanlong Xie , Xiaodan Li , Rong Zhang , Hui Xue , Xiang Tian , bolun zheng , Yaowu Chen