English
Related papers

Related papers: Localized Shortcut Removal

200 papers

The goal of machine learning is to develop predictors that generalize well to test data. Ideally, this is achieved by training on an almost infinitely large training data set that captures all variations in the data distribution. In…

Machine Learning · Computer Science 2014-02-28 Laurens van der Maaten , Minmin Chen , Stephen Tyree , Kilian Weinberger

The goal of machine learning is to provide solutions which are trained by data or by experience coming from the environment. Many training algorithms exist and some brilliant successes were achieved. But even in structured environments for…

Adaptation and Self-Organizing Systems · Physics 2011-09-06 Wolfgang Konen

Robust long-term visual localization in complex industrial environments is critical for mobile robotic systems. Existing approaches face limitations: handcrafted features are illumination-sensitive, learned features are computationally…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Yicheng Lin , Yunlong Jiang , Xujia Jiao , Bin Han

Machine learning model bias can arise from dataset composition: correlated sensitive features can distort the downstream classification model's decision boundary and lead to performance differences along these features. Existing de-biasing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Miao Zhang , Zee fryer , Ben Colman , Ali Shahriyari , Gaurav Bharaj

A key task of data science is to identify relevant features linked to certain output variables that are supposed to be modeled or predicted. To obtain a small but meaningful model, it is important to find stochastically independent…

Methodology · Statistics 2021-12-23 Tim Breitenbach , Lauritz Rasbach , Chunguang Liang , Patrick Jahnke

Feature Learning aims to extract relevant information contained in data sets in an automated fashion. It is driving force behind the current deep learning trend, a set of methods that have had widespread empirical success. What is lacking…

Machine Learning · Statistics 2015-04-02 Brendan van Rooyen , Robert C. Williamson

Machine unlearning -- efficiently removing the effect of a small "forget set" of training data on a pre-trained machine learning model -- has recently attracted significant research interest. Despite this interest, however, recent work…

Machine Learning · Computer Science 2024-11-13 Kristian Georgiev , Roy Rinberg , Sung Min Park , Shivam Garg , Andrew Ilyas , Aleksander Madry , Seth Neel

While existing social bot detectors perform well on benchmarks, their robustness across diverse real-world scenarios remains limited due to unclear ground truth and varied misleading cues. In particular, the impact of shortcut learning,…

Computation and Language · Computer Science 2026-03-24 Shiyan Zheng , Herun Wan , Minnan Luo , Junhang Huang

We investigate fast methods that allow to quickly eliminate variables (features) in supervised learning problems involving a convex loss function and a $l_1$-norm penalty, leading to a potentially substantial reduction in the number of…

Machine Learning · Computer Science 2010-10-28 Laurent El Ghaoui , Vivian Viallon , Tarek Rabbani

Shortcut learning occurs when a deep neural network overly relies on spurious correlations in the training dataset in order to solve downstream tasks. Prior works have shown how this impairs the compositional generalization capability of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Piyapat Saranrittichai , Chaithanya Kumar Mummadi , Claudia Blaiotta , Mauricio Munoz , Volker Fischer

This work tackles a central machine learning problem of performance degradation on out-of-distribution (OOD) test sets. The problem is particularly salient in medical imaging based diagnosis system that appears to be accurate but fails when…

Image and Video Processing · Electrical Eng. & Systems 2022-09-12 Xin Li , Yao Qiang , Chengyin Li , Sijia Liu , Dongxiao Zhu

Dataset bias is a critical challenge in machine learning since it often leads to a negative impact on a model due to the unintended decision rules captured by spurious correlations. Although existing works often handle this issue based on…

Machine Learning · Computer Science 2022-04-05 Seonguk Seo , Joon-Young Lee , Bohyung Han

Modern applications of machine learning (ML) deal with increasingly heterogeneous datasets comprised of data collected from overlapping latent subpopulations. As a result, traditional models trained over large datasets may fail to recognize…

Machine Learning · Statistics 2019-10-16 Benjamin Lengerich , Bryon Aragam , Eric P. Xing

Coreset selection targets the challenge of finding a small, representative subset of a large dataset that preserves essential patterns for effective machine learning. Although several surveys have examined data reduction strategies before,…

Machine Learning · Computer Science 2026-01-30 Brian B. Moser , Arundhati S. Shanbhag , Stanislav Frolov , Federico Raue , Joachim Folz , Andreas Dengel

As concerns around data privacy in machine learning grow, the ability to unlearn, or remove, specific data points from trained models becomes increasingly important. While state of the art unlearning methods have emerged in response, they…

Machine Learning · Computer Science 2025-12-08 Anat Kleiman , Robert Fisher , Ben Deaner , Udi Wieder

Self-supervised approaches for video have shown impressive results in video understanding tasks. However, unlike early works that leverage temporal self-supervision, current state-of-the-art methods primarily rely on tasks from the image…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Ishan Rajendrakumar Dave , Simon Jenni , Mubarak Shah

Large-scale supervised classification algorithms, especially those based on deep convolutional neural networks (DCNNs), require vast amounts of training data to achieve state-of-the-art performance. Decreasing this data requirement would…

Computer Vision and Pattern Recognition · Computer Science 2016-06-15 Maya Kabkab , Azadeh Alavi , Rama Chellappa

Machine unlearning is the problem of removing the effect of a subset of training data (the ''forget set'') from a trained model without damaging the model's utility e.g. to comply with users' requests to delete their data, or remove…

Machine Learning · Computer Science 2024-11-01 Kairan Zhao , Meghdad Kurmanji , George-Octavian Bărbulescu , Eleni Triantafillou , Peter Triantafillou

Recent years have witnessed an abundance of new publications and approaches on meta-learning. This community-wide enthusiasm has sparked great insights but has also created a plethora of seemingly different frameworks, which can be hard to…

Machine Learning · Computer Science 2020-02-04 Wei-Lun Chao , Han-Jia Ye , De-Chuan Zhan , Mark Campbell , Kilian Q. Weinberger

The effectiveness of learning in massive open online courses (MOOCs) can be significantly enhanced by introducing personalized intervention schemes which rely on building predictive models of student learning behaviors such as some…

Machine Learning · Computer Science 2018-12-20 Mucong Ding , Kai Yang , Dit-Yan Yeung , Ting-Chuen Pong