English
Related papers

Related papers: When More is Less: Incorporating Additional Datase…

200 papers

Spurious correlations allow flexible models to predict well during training but poorly on related test distributions. Recent work has shown that models that satisfy particular independencies involving correlation-inducing \textit{nuisance}…

Machine Learning · Computer Science 2022-06-10 Mark Goldstein , Jörn-Henrik Jacobsen , Olina Chau , Adriel Saporta , Aahlad Puli , Rajesh Ranganath , Andrew C. Miller

Recent research has revealed that machine learning models have a tendency to leverage spurious correlations that exist in the training set but may not hold true in general circumstances. For instance, a sentiment classifier may erroneously…

Computation and Language · Computer Science 2024-02-06 Oscar Chew , Hsuan-Tien Lin , Kai-Wei Chang , Kuan-Hao Huang

While deep learning models have shown remarkable performance in various tasks, they are susceptible to learning non-generalizable spurious features rather than the core features that are genuinely correlated to the true label. In this…

Machine Learning · Computer Science 2023-10-31 Yihe Deng , Yu Yang , Baharan Mirzasoleiman , Quanquan Gu

In clinical settings, we often face the challenge of building prediction models based on small observational data sets. For example, such a data set might be from a medical center in a multi-center study. Differences between centers might…

Natural language processing models often exploit spurious correlations between task-independent features and labels in datasets to perform well only within the distributions they are trained on, while not generalising to different task…

Computation and Language · Computer Science 2022-03-25 Yuxiang Wu , Matt Gardner , Pontus Stenetorp , Pradeep Dasigi

Self-supervised pre-training of deep learning models with contrastive learning is a widely used technique in image analysis. Current findings indicate a strong potential for contrastive pre-training on medical images. However, further…

Image and Video Processing · Electrical Eng. & Systems 2024-10-21 Daniel Wolf , Tristan Payer , Catharina Silvia Lisson , Christoph Gerhard Lisson , Meinrad Beer , Michael Götz , Timo Ropinski

A common assumption exists according to which machine learning models improve their performance when they have more data to learn from. In this study, the authors wished to clarify the dilemma by performing an empirical experiment utilizing…

Machine Learning · Computer Science 2021-12-20 Antti Kariluoto , Arto Pärnänen , Joni Kultanen , Jukka Soininen , Pekka Abrahamsson

Distribution shifts are common in real-world datasets and can affect the performance and reliability of deep learning models. In this paper, we study two types of distribution shifts: diversity shifts, which occur when test samples exhibit…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Alceu Bissoto , Catarina Barata , Eduardo Valle , Sandra Avila

Data scarcity is a major challenge in medical imaging, particularly for deep learning models. While data pooling (combining datasets from multiple sources) and data addition (adding more data from a new dataset) have been shown to enhance…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Ayush Roy , Samin Enam , Jun Xia , Won Hwa Kim , Vishnu Suresh Lokhande

Deep Neural Networks (DNNs) are prone to learning spurious features that correlate with the label during training but are irrelevant to the learning problem. This hurts model generalization and poses problems when deploying them in…

Machine Learning · Computer Science 2023-10-17 Nihal Murali , Aahlad Puli , Ke Yu , Rajesh Ranganath , Kayhan Batmanghelich

Deep learning approaches have demonstrated remarkable progress in automatic Chest X-ray analysis. The data-driven feature of deep models requires training data to cover a large distribution. Therefore, it is substantial to integrate…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Luyang Luo , Lequan Yu , Hao Chen , Quande Liu , Xi Wang , Jiaqi Xu , Pheng-Ann Heng

Hierarchical probabilistic models, such as mixture models, are used for cluster analysis. These models have two types of variables: observable and latent. In cluster analysis, the latent variable is estimated, and it is expected that…

Machine Learning · Statistics 2017-06-26 Keisuke Yamazaki

Model merging is attracting attention as a novel method for creating a new model by combining the weights of different trained models. While previous studies reported that model merging works well for models trained on a single dataset with…

Machine Learning · Computer Science 2024-09-23 Masanori Yamada , Tomoya Yamashita , Shin'ya Yamaguchi , Daiki Chijiwa

Neural networks trained on real-world data often exhibit biases while simultaneously being vulnerable to privacy attacks aimed at extracting sensitive information. Despite extensive research on each problem individually, their intersection…

Machine Learning · Computer Science 2025-10-07 Chenxiang Zhang , Jun Pang , Sjouke Mauw

Despite the success of machine learning applications in science, industry, and society in general, many approaches are known to be non-robust, often relying on spurious correlations to make predictions. Spuriousness occurs when some…

Computer Vision and Pattern Recognition · Computer Science 2021-06-04 Chun-Hao Chang , George Alexandru Adam , Anna Goldenberg

Learning correlations from data forms the foundation of today's machine learning (ML) and artificial intelligence research. While contemporary methods enable the automatic discovery of complex patterns, they are prone to failure when…

Machine Learning · Computer Science 2026-05-05 Samuel J. Bell , Skyler Wang

The presence of spurious features interferes with the goal of obtaining robust models that perform well across many groups within the population. A natural remedy is to remove spurious features from the model. However, in this work we show…

Machine Learning · Computer Science 2020-12-09 Fereshte Khani , Percy Liang

Medical conversation summarization is integral in capturing information gathered during interactions between patients and physicians. Summarized conversations are used to facilitate patient hand-offs between physicians, and as part of…

Computation and Language · Computer Science 2021-11-30 Varun Nair , Namit Katariya , Xavier Amatriain , Ilya Valmianski , Anitha Kannan

One challenging property lurking in medical datasets is the imbalanced data distribution, where the frequency of the samples between the different classes is not balanced. Training a model on an imbalanced dataset can introduce unique…

Image and Video Processing · Electrical Eng. & Systems 2022-04-06 Ashkan Khakzar , Yawei Li , Yang Zhang , Mirac Sanisoglu , Seong Tae Kim , Mina Rezaei , Bernd Bischl , Nassir Navab

To test the hypothesis that accuracy, discrimination, and precision in predicting postoperative complications improve when using both preoperative and intraoperative data input features versus preoperative data alone. Models that predict…