English
Related papers

Related papers: Autoencoder based approach for the mitigation of s…

200 papers

Spurious correlations are brittle associations between certain attributes of inputs and target variables, such as the correlation between an image background and an object class. Deep image classifiers often leverage them for predictions,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Guangtao Zheng , Wenqian Ye , Aidong Zhang

Traditional deep neural networks (NNs) have significantly contributed to the state-of-the-art performance in the task of classification under various application domains. However, NNs have not considered inherent uncertainty in data…

Machine Learning · Computer Science 2021-05-05 Yibo Hu , Yuzhe Ou , Xujiang Zhao , Jin-Hee Cho , Feng Chen

Wireless sensor networks (WSN) are fundamental to the Internet of Things (IoT) by bridging the gap between the physical and the cyber worlds. Anomaly detection is a critical task in this context as it is responsible for identifying various…

Networking and Internet Architecture · Computer Science 2018-12-14 Tie Luo , Sai G. Nagarajan

Deep classifiers are known to rely on spurious features $\unicode{x2013}$ patterns which are correlated with the target on the training data but not inherently relevant to the learning problem, such as the image backgrounds when classifying…

Machine Learning · Computer Science 2022-10-21 Pavel Izmailov , Polina Kirichenko , Nate Gruver , Andrew Gordon Wilson

Out-of-distribution (OOD) detection is critical to ensure the safe deployment of deep learning models in critical applications. Deep learning models can often misidentify OOD samples as in-distribution (ID) samples. This vulnerability…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Sudarshan Regmi

Benchmarks for out-of-distribution (OOD) generalization frequently show a strong positive correlation between in-distribution (ID) and OOD accuracy across models, termed "accuracy-on-the-line." This pattern is often taken to imply that…

Machine Learning · Computer Science 2025-10-30 Olawale Salaudeen , Haoran Zhang , Kumail Alhamoud , Sara Beery , Marzyeh Ghassemi

Deep neural networks are behind many of the recent successes in machine learning applications. However, these models can produce overconfident decisions while encountering out-of-distribution (OOD) examples or making a wrong prediction.…

Machine Learning · Computer Science 2021-06-24 Navid Kardan , Ankit Sharma , Kenneth O. Stanley

Model substructure learning aims to find an invariant network substructure that can have better out-of-distribution (OOD) generalization than the original full structure. Existing works usually search the invariant substructure using…

Machine Learning · Computer Science 2023-06-05 Yingchun Wang , Jingcai Guo , Yi Liu , Song Guo , Weizhan Zhang , Xiangyong Cao , Qinghua Zheng

Modern deep neural networks are well known to be brittle in the face of unknown data instances and recognition of the latter remains a challenge. Although it is inevitable for continual-learning systems to encounter such unseen concepts,…

Machine Learning · Computer Science 2022-04-04 Martin Mundt , Iuliia Pliushch , Sagnik Majumder , Yongwon Hong , Visvanathan Ramesh

In the absence of sufficient data variation (e.g., scanner and protocol variability) in annotated data, deep neural networks (DNNs) tend to overfit during training. As a result, their performance is significantly lower on data from unseen…

We introduce the Differentiable Weightless Neural Network (DWN), a model based on interconnected lookup tables. Training of DWNs is enabled by a novel Extended Finite Difference technique for approximate differentiation of binary values. We…

Deep Neural Networks (DNNs) are being deployed in a wide range of settings today, from safety-critical applications like autonomous driving to commercial applications involving image classifications. However, recent research has shown that…

Software Engineering · Computer Science 2021-01-26 Ziyuan Zhong , Yuchi Tian , Baishakhi Ray

Motivated by the attention mechanism of the human visual system and recent developments in the field of machine translation, we introduce our attention-based and recurrent sequence to sequence autoencoders for fully unsupervised…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-20 Shahin Amiriparian , Pawel Winokurow , Vincent Karas , Sandra Ottl , Maurice Gerczuk , Björn W. Schuller

Unsupervised learning-based anomaly detection in latent space has gained importance since discriminating anomalies from normal data becomes difficult in high-dimensional space. Both density estimation and distance-based methods to detect…

Machine Learning · Computer Science 2024-02-16 Padmaksha Roy

A critical vulnerability of supervised deep learning in high-dimensional tabular domains is "generalization collapse": models form precise decision boundaries around known training distributions but fail catastrophically when encountering…

Machine Learning · Computer Science 2026-03-10 Rajeeb Thapa Chhetri , Saurab Thapa , Avinash Kumar , Zhixiong Chen

Deep Convolutional Neural Networks (DCNN) have established a remarkable performance benchmark in the field of image classification, displacing classical approaches based on hand-tailored aggregations of local descriptors. Yet DCNNs impose…

Computer Vision and Pattern Recognition · Computer Science 2015-03-16 Praveen Kulkarni , Joaquin Zepeda , Frederic Jurie , Patrick Perez , Louis Chevallier

Deep neural networks often rely on spurious correlations to make predictions, which hinders generalization beyond training environments. For instance, models that associate cats with bed backgrounds can fail to predict the existence of cats…

Machine Learning · Computer Science 2023-06-06 Shirley Wu , Mert Yuksekgonul , Linjun Zhang , James Zou

The adoption of deep neural networks (DNNs) in safety-critical contexts is often prevented by the lack of effective means to explain their results, especially when they are erroneous. In our previous work, we proposed a white-box approach…

Software Engineering · Computer Science 2024-01-18 Mohammed Oualid Attaoui , Hazem Fahmy , Fabrizio Pastore , Lionel Briand

Spurious correlation caused by subgroup underrepresentation has received increasing attention as a source of bias that can be perpetuated by deep neural networks (DNNs). Distributionally robust optimization has shown success in addressing…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Nilesh Kumar , Ruby Shrestha , Zhiyuan Li , Linwei Wang

Recent research has revealed that machine learning models have a tendency to leverage spurious correlations that exist in the training set but may not hold true in general circumstances. For instance, a sentiment classifier may erroneously…

Computation and Language · Computer Science 2024-02-06 Oscar Chew , Hsuan-Tien Lin , Kai-Wei Chang , Kuan-Hao Huang