English
Related papers

Related papers: Orthogonal Uncertainty Representation of Data Mani…

200 papers

One key challenge in Out-of-Distribution (OOD) detection is the absence of ground-truth OOD samples during training. One principled approach to address this issue is to use samples from external datasets as outliers (i.e., pseudo OOD…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Wenjun Miao , Guansong Pang , Jin Zheng , Xiao Bai

Real-world datasets commonly exhibit noisy labels and class imbalance, such as long-tailed distributions. While previous research addresses this issue by differentiating noisy and clean samples, reliance on information from predictions…

Machine Learning · Computer Science 2024-03-06 Ying-Hsuan Wu , Jun-Wei Hsieh , Li Xin , Shin-You Teng , Yi-Kuan Hsieh , Ming-Ching Chang

Deep convolutional neural network (CNN) based models are vulnerable to the adversarial attacks. One of the possible reasons is that the embedding space of CNN based model is sparse, resulting in a large space for the generation of…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Haozhe Liu , Haoqin Ji , Yuexiang Li , Nanjun He , Haoqian Wu , Feng Liu , Linlin Shen , Yefeng Zheng

Including prior information about model parameters is a fundamental step of any Bayesian statistical analysis. It is viewed positively by some as it allows, among others, to quantitatively incorporate expert opinion about model parameters.…

Methodology · Statistics 2023-08-22 Philippe Gagnon

Offline Reinforcement Learning (RL) presents a promising paradigm for training autonomous vehicle (AV) planning policies from large-scale, real-world driving logs. However, the extreme data imbalance in these logs, where mundane scenarios…

Robotics · Computer Science 2025-09-18 Antonio Guillen-Perez

Deep learning models can perform well when evaluated on images from the same distribution as the training set. However, applying small perturbations in the forms of noise, artifacts, occlusions, blurring, etc. to a model's input image and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Zahra Golpayegani , Patrick St-Amant , Nizar Bouguila

High-dimensional data subject to heavy-tailed phenomena and heterogeneity are commonly encountered in various scientific fields and bring new challenges to the classical statistical methods. In this paper, we combine the asymmetric square…

Statistics Theory · Mathematics 2019-10-02 Jun Zhao , Guan'ao Yan , Yi Zhang

The training datasets used in long-tailed recognition are extremely unbalanced, resulting in significant variation in per-class accuracy across categories. Prior works mostly used average accuracy to evaluate their algorithms, which easily…

Computer Vision and Pattern Recognition · Computer Science 2024-01-31 Hao Yu , Yingxiao Du , Jianxin Wu

The imbalanced distribution of long-tailed data presents a considerable challenge for deep learning models, as it causes them to prioritize the accurate classification of head classes but largely disregard tail classes. The biased decision…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Mengke Li , Zhikai Hu , Yang Lu , Weichao Lan , Yiu-ming Cheung , Hui Huang

Uncertainty estimates help to identify ambiguous, novel, or anomalous inputs, but the reliable quantification of uncertainty has proven to be challenging for modern deep networks. In order to improve uncertainty estimation, we propose…

Machine Learning · Computer Science 2021-01-18 Kanil Patel , William Beluch , Dan Zhang , Michael Pfeiffer , Bin Yang

Long-tailed recognition with imbalanced class distribution naturally emerges in practical machine learning applications. Existing methods such as data reweighing, resampling, and supervised contrastive learning enforce the class balance…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Chengkai Hou , Jieyu Zhang , Haonan Wang , Tianyi Zhou

Data uncertainty is commonly observed in the images for face recognition (FR). However, deep learning algorithms often make predictions with high confidence even for uncertain or irrelevant inputs. Intuitively, FR algorithms can benefit…

Computer Vision and Pattern Recognition · Computer Science 2022-12-05 Lei Shang , Mouxiao Huang , Wu Shi , Yuchen Liu , Yang Liu , Fei Wang , Baigui Sun , Xuansong Xie , Yu Qiao

Deep neural networks are vulnerable to adversarial attacks, often leading to erroneous outputs. Adversarial training has been recognized as one of the most effective methods to counter such attacks. However, existing adversarial training…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Xinli Yue , Ningping Mou , Qian Wang , Lingchen Zhao

Although deep neural networks achieve tremendous success on various classification tasks, the generalization ability drops sheer when training datasets exhibit long-tailed distributions. One of the reasons is that the learned…

Machine Learning · Computer Science 2023-02-27 Xuantong Liu , Jianfeng Zhang , Tianyang Hu , He Cao , Lujia Pan , Yuan Yao

A fundamental challenge in physics-informed machine learning (PIML) is the design of robust PIML methods for out-of-distribution (OOD) forecasting tasks. These OOD tasks require learning-to-learn from observations of the same (ODE)…

Machine Learning · Computer Science 2023-03-07 S Chandra Mouli , Muhammad Ashraful Alam , Bruno Ribeiro

Machine unlearning, which aims to efficiently remove the influence of specific data from trained models, is crucial for upholding data privacy regulations like the ``right to be forgotten". However, existing research predominantly evaluates…

Machine Learning · Computer Science 2026-02-24 Liheng Yu , Zhe Zhao , Yuxuan Wang , Pengkun Wang , Xiaofeng Cao , Binwu Wang , Yang Wang

Linear regression is ubiquitous in statistical analysis. It is well understood that conflicting sources of information may contaminate the inference when the classical normality of errors is assumed. The contamination caused by the light…

Methodology · Statistics 2019-06-13 Philippe Gagnon , Alain Desgagné , Mylène Bédard

In many real-world applications, the frequency distribution of class labels for training data can exhibit a long-tailed distribution, which challenges traditional approaches of training deep neural networks that require heavy amounts of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Richard Franklin , Jiawei Yao , Deyang Zhong , Qi Qian , Juhua Hu

Imbalanced classification datasets pose significant challenges in machine learning, often leading to biased models that perform poorly on underrepresented classes. With the rise of foundation models, recent research has focused on the full,…

Machine Learning · Computer Science 2025-09-22 Nakul Sharma

Retrieval systems rely on representations learned by increasingly powerful models. However, due to the high training cost and inconsistencies in learned representations, there is significant interest in facilitating communication between…

Machine Learning · Computer Science 2026-05-20 Simone Ricci , Niccolò Biondi , Federico Pernici , Ioannis Patras , Alberto Del Bimbo