English
Related papers

Related papers: Elastic Representation: Mitigating Spurious Correl…

200 papers

We consider learning from labeled data collected across multiple environments, where the data distribution may vary across these environments. This problem is commonly approached from a causal perspective, seeking invariant representations…

Machine Learning · Statistics 2026-04-30 Yuli Slavutsky , David M. Blei

Archetypes are typical population representatives in an extremal sense, where typicality is understood as the most extreme manifestation of a trait or feature. In linear feature space, archetypes approximate the data convex hull allowing…

Computer Vision and Pattern Recognition · Computer Science 2020-02-04 Sebastian Mathias Keller , Maxim Samarin , Fabricio Arend Torres , Mario Wieser , Volker Roth

Spurious correlations in training data often lead to robustness issues since models learn to use them as shortcuts. For example, when predicting whether an object is a cow, a model might learn to rely on its green background, so it would do…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Raghav Mehta , Vítor Albiero , Li Chen , Ivan Evtimov , Tamar Glaser , Zhiheng Li , Tal Hassner

This work tackles an intriguing and fundamental open challenge in representation learning: Given a well-trained deep learning model, can it be reprogrammed to enhance its robustness against adversarial or noisy input perturbations without…

Machine Learning · Computer Science 2024-10-08 Zhichao Hou , MohamadAli Torkamani , Hamid Krim , Xiaorui Liu

A fundamental challenge of over-parameterized deep learning models is learning meaningful data representations that yield good performance on a downstream task without over-fitting spurious input features. This work proposes MaskTune, a…

Deep neural networks have emerged as a powerful technique for learning representations from user-item interaction data in collaborative filtering (CF) for recommender systems. However, many existing methods heavily rely on unique user and…

Information Retrieval · Computer Science 2025-10-21 Xubin Ren , Chao Huang

Person re-identification is a challenging task because of the high intra-class variance induced by the unrestricted nuisance factors of variations such as pose, illumination, viewpoint, background, and sensor noise. Recent approaches…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Sinan Sabri , Zaigham Randhawa , Gianfranco Doretto

Nonlinear regression has been extensively employed in many computer vision problems (e.g., crowd counting, age estimation, affective computing). Under the umbrella of deep learning, two common solutions exist i) transforming nonlinear…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Le Zhang , Zenglin Shi , Ming-Ming Cheng , Yun Liu , Jia-Wang Bian , Joey Tianyi Zhou , Guoyan Zheng , Zeng Zeng

We consider a weakly supervised learning problem called Learning from Label Proportions (LLP), where examples are grouped into ``bags'' and only the average label within each bag is revealed to the learner. We study various learning rules…

Machine Learning · Computer Science 2024-06-04 Gene Li , Lin Chen , Adel Javanmard , Vahab Mirrokni

Coreset selection methods have shown promise in reducing the training data size while maintaining model performance for data-efficient machine learning. However, as many datasets suffer from biases that cause models to learn spurious…

Machine Learning · Computer Science 2025-10-22 Amaya Dharmasiri , William Yang , Polina Kirichenko , Lydia Liu , Olga Russakovsky

Deep networks for computer vision are not reliable when they encounter adversarial examples. In this paper, we introduce a framework that uses the dense intrinsic constraints in natural images to robustify inference. By introducing…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Chengzhi Mao , Lingyu Zhang , Abhishek Joshi , Junfeng Yang , Hao Wang , Carl Vondrick

Improving fairness between privileged and less-privileged sensitive attribute groups (e.g, {race, gender}) has attracted lots of attention. To enhance the model performs uniformly well in different sensitive attributes, we propose a…

Machine Learning · Computer Science 2022-10-14 Qi Qi , Shervin Ardeshir , Yi Xu , Tianbao Yang

It is well-known that training neural networks for image classification with empirical risk minimization (ERM) makes them vulnerable to relying on spurious attributes instead of causal ones for prediction. Previously, deep feature…

Existing federated learning models that follow the standard risk minimization paradigm of machine learning often fail to generalize in the presence of spurious correlations in the training data. In many real-world distributed settings,…

Machine Learning · Computer Science 2023-05-31 Praveen Venkateswaran , Vatche Isahagian , Vinod Muthusamy , Nalini Venkatasubramanian

Large training datasets almost always contain examples with inaccurate or incorrect labels. Deep Neural Networks (DNNs) tend to overfit training label noise, resulting in poorer model performance in practice. To address this problem, we…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Chen Gong , Kong Bin , Eric J. Seibel , Xin Wang , Youbing Yin , Qi Song

Extreme learning machine (ELM) is a new single hidden layer feedback neural network. The weights of the input layer and the biases of neurons in hidden layer are randomly generated, the weights of the output layer can be analytically…

Machine Learning · Computer Science 2018-03-13 Lin Feng , Shuliang Xu , Feilong Wang , Shenglan Liu

State-of-the-art, high capacity deep neural networks not only require large amounts of labelled training data, they are also highly susceptible to label errors in this data, typically resulting in large efforts and costs and therefore…

Machine Learning · Computer Science 2020-07-20 Christian Haase-Schütz , Rainer Stal , Heinz Hertlein , Bernhard Sick

Federated Learning offers a solution for decentralised model training, addressing the difficulties associated with distributed data and privacy in machine learning. However, the fact of data heterogeneity in federated learning frequently…

Machine Learning · Computer Science 2025-09-10 Ozgu Goksu , Nicolas Pugeault

State-of-the-art techniques for enhancing robustness of deep networks mostly rely on empirical risk minimization with suitable data augmentation. In this paper, we propose a complementary approach motivated by communication theory, aimed at…

Machine Learning · Computer Science 2024-03-05 Bhagyashree Puranik , Ahmad Beirami , Yao Qin , Upamanyu Madhow

Deep learning models have shown considerable vulnerability to adversarial attacks, particularly as attacker strategies become more sophisticated. While traditional adversarial training (AT) techniques offer some resilience, they often focus…

Machine Learning · Computer Science 2024-07-15 Ren Wang , Yuxuan Li , Alfred Hero