English
Related papers

Related papers: Spurious Correlation-Aware Embedding Regularizatio…

200 papers

The deep neural network (DNN) has been proven effective in various domains. However, they often struggle to perform well on certain minority groups during inference, despite showing strong performance on the majority of data groups. This is…

Machine Learning · Computer Science 2023-12-11 Jiaxu Zhao , Lu Yin , Shiwei Liu , Meng Fang , Mykola Pechenizkiy

The visual models pretrained on large-scale benchmarks encode general knowledge and prove effective in building more powerful representations for downstream tasks. Most existing approaches follow the fine-tuning paradigm, either by…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Nan Zhou , Jiaxin Chen , Di Huang

Recent research has highlighted a critical issue known as ``robust fairness", where robust accuracy varies significantly across different classes, undermining the reliability of deep neural networks (DNNs). A common approach to address this…

Machine Learning · Computer Science 2025-01-24 Gaojie Jin , Sihao Wu , Jiaxu Liu , Tianjin Huang , Ronghui Mu

Training a deep neural network with a small amount of data is a challenging problem as it is vulnerable to overfitting. However, one of the practical difficulties that we often face is to collect many samples. Transfer learning is a…

Machine Learning · Computer Science 2020-07-13 Yunho Jeon , Yongseok Choi , Jaesun Park , Subin Yi , Dongyeon Cho , Jiwon Kim

Confusing classes that are ubiquitous in real world often degrade performance for many vision related applications like object detection, classification, and segmentation. The confusion errors are not only caused by similar visual patterns…

Computer Vision and Pattern Recognition · Computer Science 2018-08-02 Qichuan Geng , Xinyu Huang , Zhong Zhou , Ruigang Yang

Deep Neural Networks (DNNs) are prone to learning spurious features that correlate with the label during training but are irrelevant to the learning problem. This hurts model generalization and poses problems when deploying them in…

Machine Learning · Computer Science 2023-10-17 Nihal Murali , Aahlad Puli , Ke Yu , Rajesh Ranganath , Kayhan Batmanghelich

Deep Neural Networks (DNNs) are increasingly utilized in high-stakes domains like medical diagnostics and autonomous driving where model reliability is critical. However, the research landscape for ensuring this reliability is…

Machine Learning · Computer Science 2026-04-07 Ole Delzer , Sidney Bender

Self-supervised learning systems have gained significant attention in recent years by leveraging clustering-based pseudo-labels to provide supervision without the need for human annotations. However, the noise in these pseudo-labels caused…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Zia-ur-Rehman , Arif Mahmood , Wenxiong Kang

Self-supervised learning (SSL) typically learns representations invariant to semantic-preserving augmentations. While effective for recognition, enforcing strong invariance can suppress transformation-dependent structure that is useful for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Joohyung Lee , Changhun Kim , Hyunsu Kim , Kwanhyung Lee , Juho Lee

Neural image classifiers can often learn to make predictions by overly relying on non-predictive features that are spuriously correlated with the class labels in the training data. This leads to poor performance in real-world atypical…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Sreyan Ghosh , Chandra Kiran Reddy Evuru , Sonal Kumar , Utkarsh Tyagi , Sakshi Singh , Sanjoy Chowdhury , Dinesh Manocha

We propose self-adaptive training---a new training algorithm that dynamically corrects problematic training labels by model predictions without incurring extra computational cost---to improve generalization of deep learning for potentially…

Machine Learning · Computer Science 2020-10-01 Lang Huang , Chao Zhang , Hongyang Zhang

In recent years, supervised person re-identification (re-ID) models have received increasing studies. However, these models trained on the source domain always suffer dramatic performance drop when tested on an unseen domain. Existing…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Hao Feng , Minghao Chen , Jinming Hu , Dong Shen , Haifeng Liu , Deng Cai

Modern speaker verification models use deep neural networks to encode utterance audio into discriminative embedding vectors. During the training process, these networks are typically optimized to differentiate arbitrary speakers. This…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-09 Hua Shen , Yuguang Yang , Guoli Sun , Ryan Langman , Eunjung Han , Jasha Droppo , Andreas Stolcke

The analysis of sequences (e.g., protein, DNA, and SMILES string) is essential for disease diagnosis, biomaterial engineering, genetic engineering, and drug discovery domains. Conventional analytical methods focus on transforming sequences…

Quantitative Methods · Quantitative Biology 2025-03-20 Taslim Murad , Sarwan Ali , Murray Patterson

Deep neural networks struggle to continually learn multiple sequential tasks due to catastrophic forgetting of previously learned tasks. Rehearsal-based methods which explicitly store previous task samples in the buffer and interleave them…

Machine Learning · Computer Science 2022-07-12 Prashant Bhat , Bahram Zonooz , Elahe Arani

Auto-Encoder based deep subspace clustering (DSC) is widely used in computer vision, motion segmentation and image processing. However, it suffers from the following three issues in the self-expressive matrix learning process: the first one…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Guangyi Zhao , Simin Kou , Xuesong Yin

Scene coordinate regression (SCR) has established itself as a promising learning-based approach to visual relocalization. After mere minutes of scene-specific training, SCR models estimate camera poses of query images with high accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Leonard Bruns , Axel Barroso-Laguna , Tommaso Cavallari , Áron Monszpart , Sowmya Munukutla , Victor Adrian Prisacariu , Eric Brachmann

Out-of-distribution generalization of machine learning models remains challenging since the models are inherently bound to the training data distribution. This especially manifests, when the learned models rely on spurious correlations.…

Machine Learning · Computer Science 2025-02-27 Martin Surner , Abdelmajid Khelil , Ludwig Bothmann

Real-world social events typically exhibit a severe class-imbalance distribution, which makes the trained detection model encounter a serious generalization challenge. Most studies solve this problem from the frequency perspective and…

Artificial Intelligence · Computer Science 2023-10-31 Jiaqian Ren , Hao Peng , Lei Jiang , Zhiwei Liu , Jia Wu , Zhengtao Yu , Philip S. Yu

Supervised learning models often make systematic errors on rare subsets of the data. When these subsets correspond to explicit labels in the data (e.g., gender, race) such poor performance can be identified straightforwardly. This paper…

Machine Learning · Computer Science 2021-10-19 Greg d'Eon , Jason d'Eon , James R. Wright , Kevin Leyton-Brown