English
Related papers

Related papers: Source Matters: Source Dataset Impact on Model Rob…

200 papers

Distribution shift is a major source of failure for machine learning models. However, evaluating model reliability under distribution shift can be challenging, especially since it may be difficult to acquire counterfactual examples that…

Machine Learning · Computer Science 2023-06-21 Joshua Vendrow , Saachi Jain , Logan Engstrom , Aleksander Madry

Recent research on robustness has revealed significant performance gaps between neural image classifiers trained on datasets that are similar to the test set, and those that are from a naturally shifted distribution, such as sketches,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Hritik Bansal , Aditya Grover

Training a classifier with high mean accuracy from a manifold-distributed dataset can be challenging. This problem is compounded further when there are only few labels available for training. For transfer learning to work, both the source…

Machine Learning · Computer Science 2024-08-15 Sayed W Qayyumi , Laureance F Park , Oliver Obst

Despite the burgeoning body of work on distribution shifts, provenance shift-where the relationship between data source and label changes at deployment-remains poorly understood and under-addressed. In this paper, we establish a formal…

Machine Learning · Computer Science 2026-05-13 Yongsen Tan , Zhecheng Sheng , Xiruo Ding , Serguei V. S. Pakhomov , Trevor Cohen

Shortcut learning is a phenomenon where machine learning models prioritize learning simple, potentially misleading cues from data that do not generalize well beyond the training set. While existing research primarily investigates this in…

Image and Video Processing · Electrical Eng. & Systems 2024-06-28 Manxi Lin , Nina Weng , Kamil Mikolaj , Zahra Bashir , Morten Bo Søndergaard Svendsen , Martin Tolsgaard , Anders Nymark Christensen , Aasa Feragen

Medical imaging models frequently fail when deployed across hospitals, scanners, populations, or imaging protocols due to domain shift, limiting their clinical reliability. While transfer learning and domain adaptation address such shifts…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Mohammed M. Abdelsamea , Daniel Tweneboah Anyimadu , Tasneem Selim , Saif Alzubi , Lei Zhang , Ahmed Karam Eldaly , Xujiong Ye

The recent trend of integrating multi-source Chest X-Ray datasets to improve automated diagnostics raises concerns that models learn to exploit source-specific correlations to improve performance by recognizing the source domain of an image…

Image and Video Processing · Electrical Eng. & Systems 2022-01-12 Srishti Gautam , Marina M. -C. Höhne , Stine Hansen , Robert Jenssen , Michael Kampffmeyer

While hardware-software co-design has significantly improved the efficiency of neural network inference, modeling the training phase remains a critical yet underexplored challenge. Training workloads impose distinct constraints,…

Machine Learning · Computer Science 2026-03-17 Jérémy Morlier , Robin Geens , Stef Cuyckens , Arne Symons , Marian Verhelst , Vincent Gripon , Mathieu Léonardon

Diffusion models, while trained for image generation, have emerged as powerful foundational feature extractors for downstream tasks. We find that off-the-shelf diffusion models, trained exclusively to generate natural RGB images, can…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Nurislam Tursynbek , Hastings Greer , Basar Demir , Marc Niethammer

We introduce Mediffusion -- a new method for semi-supervised learning with explainable classification based on a joint diffusion model. The medical imaging domain faces unique challenges due to scarce data labelling -- insufficient for…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Joanna Kaleta , Paweł Skierś , Jan Dubiński , Przemysław Korzeniowski , Kamil Deja

The recent vision transformer(i.e.for image classification) learns non-local attentive interaction of different patch tokens. However, prior arts miss learning the cross-scale dependencies of different pixels, the semantic correspondence of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Yuanfeng Ji , Ruimao Zhang , Huijie Wang , Zhen Li , Lingyun Wu , Shaoting Zhang , Ping Luo

Medical image segmentation is pivotal in healthcare, enhancing diagnostic accuracy, informing treatment strategies, and tracking disease progression. This process allows clinicians to extract critical information from visual data, enabling…

Image and Video Processing · Electrical Eng. & Systems 2024-10-31 Ovais Iqbal Shah , Danish Raza Rizvi , Aqib Nazir Mir

The mining and utilization of features directly affect the classification performance of models used in the classification and recognition of hyperspectral remote sensing images. Traditional models usually conduct feature mining from a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Yunsong Zhao , Yin Li , Zhihan Chen , Tianchong Qiu , Guojin Liu

The hybrid architecture of convolutional neural networks (CNNs) and Transformer are very popular for medical image segmentation. However, it suffers from two challenges. First, although a CNNs branch can capture the local image features…

Image and Video Processing · Electrical Eng. & Systems 2023-12-21 Tao Lei , Rui Sun , Xuan Wang , Yingbo Wang , Xi He , Asoke Nandi

Unmeasured confounders are a major source of bias in regression-based effect estimation and causal inference. In this paper, we advocate a new profiled transfer learning framework, ProTrans, to address confounding effects in the target…

Methodology · Statistics 2025-09-04 Ziyuan Chen , Yifan Jiang , Jingyuan Liu , Fang Yao

Several studies indicate that deep learning models can learn to detect breast cancer from mammograms (X-ray images of the breasts). However, challenges with overfitting and poor generalisability prevent their routine use in the clinic.…

Image and Video Processing · Electrical Eng. & Systems 2025-02-05 Emir Ahmed , Spencer A. Thomas , Ciaran Bench

Convolutional neural networks require numerous data for training. Considering the difficulties in data collection and labeling in some specific tasks, existing approaches generally use models pre-trained on a large source domain (e.g.…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Zhichen Zhao , Bowen Zhang , Yuning Jiang , Li Xu , Lei Li , Wei-Ying Ma

This paper investigates discrepancies in how neural networks learn from different imaging domains, which are commonly overlooked when adopting computer vision techniques from the domain of natural images to other specialized domains such as…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Nicholas Konz , Maciej A. Mazurowski

Image-to-image reconstruction problems with free or inexpensive metadata in the form of class labels appear often in biological and medical image domains. Existing text-guided or style-transfer image-to-image approaches do not translate to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Jan Oscar Cross-Zamirski , Praveen Anand , Guy Williams , Elizabeth Mouchet , Yinhai Wang , Carola-Bibiane Schönlieb

Deep neural networks have demonstrated impressive performance in various machine learning tasks. However, they are notoriously sensitive to changes in data distribution. Often, even a slight change in the distribution can lead to drastic…

Computer Vision and Pattern Recognition · Computer Science 2018-11-16 Alon Hazan , Yoel Shoshan , Daniel Khapun , Roy Aladjem , Vadim Ratner