中文
相关论文

相关论文: When More is Less: Incorporating Additional Datase…

200 篇论文

Spurious correlations allow flexible models to predict well during training but poorly on related test distributions. Recent work has shown that models that satisfy particular independencies involving correlation-inducing \textit{nuisance}…

Recent research has revealed that machine learning models have a tendency to leverage spurious correlations that exist in the training set but may not hold true in general circumstances. For instance, a sentiment classifier may erroneously…

计算与语言 · 计算机科学 2024-02-06 Oscar Chew , Hsuan-Tien Lin , Kai-Wei Chang , Kuan-Hao Huang

While deep learning models have shown remarkable performance in various tasks, they are susceptible to learning non-generalizable spurious features rather than the core features that are genuinely correlated to the true label. In this…

机器学习 · 计算机科学 2023-10-31 Yihe Deng , Yu Yang , Baharan Mirzasoleiman , Quanquan Gu

In clinical settings, we often face the challenge of building prediction models based on small observational data sets. For example, such a data set might be from a medical center in a multi-center study. Differences between centers might…

Natural language processing models often exploit spurious correlations between task-independent features and labels in datasets to perform well only within the distributions they are trained on, while not generalising to different task…

计算与语言 · 计算机科学 2022-03-25 Yuxiang Wu , Matt Gardner , Pontus Stenetorp , Pradeep Dasigi

Self-supervised pre-training of deep learning models with contrastive learning is a widely used technique in image analysis. Current findings indicate a strong potential for contrastive pre-training on medical images. However, further…

图像与视频处理 · 电气工程与系统科学 2024-10-21 Daniel Wolf , Tristan Payer , Catharina Silvia Lisson , Christoph Gerhard Lisson , Meinrad Beer , Michael Götz , Timo Ropinski

A common assumption exists according to which machine learning models improve their performance when they have more data to learn from. In this study, the authors wished to clarify the dilemma by performing an empirical experiment utilizing…

机器学习 · 计算机科学 2021-12-20 Antti Kariluoto , Arto Pärnänen , Joni Kultanen , Jukka Soininen , Pekka Abrahamsson

Distribution shifts are common in real-world datasets and can affect the performance and reliability of deep learning models. In this paper, we study two types of distribution shifts: diversity shifts, which occur when test samples exhibit…

计算机视觉与模式识别 · 计算机科学 2023-12-22 Alceu Bissoto , Catarina Barata , Eduardo Valle , Sandra Avila

Data scarcity is a major challenge in medical imaging, particularly for deep learning models. While data pooling (combining datasets from multiple sources) and data addition (adding more data from a new dataset) have been shown to enhance…

计算机视觉与模式识别 · 计算机科学 2026-02-27 Ayush Roy , Samin Enam , Jun Xia , Won Hwa Kim , Vishnu Suresh Lokhande

Deep Neural Networks (DNNs) are prone to learning spurious features that correlate with the label during training but are irrelevant to the learning problem. This hurts model generalization and poses problems when deploying them in…

机器学习 · 计算机科学 2023-10-17 Nihal Murali , Aahlad Puli , Ke Yu , Rajesh Ranganath , Kayhan Batmanghelich

Deep learning approaches have demonstrated remarkable progress in automatic Chest X-ray analysis. The data-driven feature of deep models requires training data to cover a large distribution. Therefore, it is substantial to integrate…

计算机视觉与模式识别 · 计算机科学 2020-06-09 Luyang Luo , Lequan Yu , Hao Chen , Quande Liu , Xi Wang , Jiaqi Xu , Pheng-Ann Heng

Hierarchical probabilistic models, such as mixture models, are used for cluster analysis. These models have two types of variables: observable and latent. In cluster analysis, the latent variable is estimated, and it is expected that…

机器学习 · 统计学 2017-06-26 Keisuke Yamazaki

Model merging is attracting attention as a novel method for creating a new model by combining the weights of different trained models. While previous studies reported that model merging works well for models trained on a single dataset with…

机器学习 · 计算机科学 2024-09-23 Masanori Yamada , Tomoya Yamashita , Shin'ya Yamaguchi , Daiki Chijiwa

Neural networks trained on real-world data often exhibit biases while simultaneously being vulnerable to privacy attacks aimed at extracting sensitive information. Despite extensive research on each problem individually, their intersection…

机器学习 · 计算机科学 2025-10-07 Chenxiang Zhang , Jun Pang , Sjouke Mauw

Despite the success of machine learning applications in science, industry, and society in general, many approaches are known to be non-robust, often relying on spurious correlations to make predictions. Spuriousness occurs when some…

计算机视觉与模式识别 · 计算机科学 2021-06-04 Chun-Hao Chang , George Alexandru Adam , Anna Goldenberg

Learning correlations from data forms the foundation of today's machine learning (ML) and artificial intelligence research. While contemporary methods enable the automatic discovery of complex patterns, they are prone to failure when…

机器学习 · 计算机科学 2026-05-05 Samuel J. Bell , Skyler Wang

The presence of spurious features interferes with the goal of obtaining robust models that perform well across many groups within the population. A natural remedy is to remove spurious features from the model. However, in this work we show…

机器学习 · 计算机科学 2020-12-09 Fereshte Khani , Percy Liang

Medical conversation summarization is integral in capturing information gathered during interactions between patients and physicians. Summarized conversations are used to facilitate patient hand-offs between physicians, and as part of…

计算与语言 · 计算机科学 2021-11-30 Varun Nair , Namit Katariya , Xavier Amatriain , Ilya Valmianski , Anitha Kannan

One challenging property lurking in medical datasets is the imbalanced data distribution, where the frequency of the samples between the different classes is not balanced. Training a model on an imbalanced dataset can introduce unique…

图像与视频处理 · 电气工程与系统科学 2022-04-06 Ashkan Khakzar , Yawei Li , Yang Zhang , Mirac Sanisoglu , Seong Tae Kim , Mina Rezaei , Bernd Bischl , Nassir Navab

To test the hypothesis that accuracy, discrimination, and precision in predicting postoperative complications improve when using both preoperative and intraoperative data input features versus preoperative data alone. Models that predict…