中文
相关论文

相关论文: When Fine-Tuning Changes the Evidence: Architectur…

200 篇论文

A common approach to transfer learning under distribution shift is to fine-tune the last few layers of a pre-trained model, preserving learned features while also adapting to the new task. This paper shows that in such settings, selectively…

机器学习 · 计算机科学 2023-06-07 Yoonho Lee , Annie S. Chen , Fahim Tajwar , Ananya Kumar , Huaxiu Yao , Percy Liang , Chelsea Finn

As the adoption of deep learning models has grown beyond human capacity for verification, meta-algorithms are needed to ensure reliable model inference. Concept drift detection is a field dedicated to identifying statistical shifts that is…

机器学习 · 计算机科学 2025-05-08 Jacob Glenn Ayers , Buvaneswari A. Ramanan , Manzoor A. Khan

Most semantic drift studies report multiple signals e.g., embedding displacement, neighbor changes, distributional divergence, and recursive trajectory instability, without a shared explanatory theory that relates them. This paper proposes…

计算与语言 · 计算机科学 2026-02-24 Stephen Russell

Deep learning has transformed computer vision but relies heavily on large labeled datasets and computational resources. Transfer learning, particularly fine-tuning pretrained models, offers a practical alternative; however, models…

计算机视觉与模式识别 · 计算机科学 2025-05-23 Iván Matas , Carmen Serrano , Miguel Nogales , David Moreno , Lara Ferrándiz , Teresa Ojeda , Begoña Acha

The notion of concept drift refers to the phenomenon that the distribution generating the observed data changes over time. If drift is present, machine learning models may become inaccurate and need adjustment. Many technologies for…

机器学习 · 计算机科学 2022-12-05 Fabian Hinder , Valerie Vaquet , Johannes Brinkrolf , Barbara Hammer

Medical imaging models frequently fail when deployed across hospitals, scanners, populations, or imaging protocols due to domain shift, limiting their clinical reliability. While transfer learning and domain adaptation address such shifts…

计算机视觉与模式识别 · 计算机科学 2026-03-26 Mohammed M. Abdelsamea , Daniel Tweneboah Anyimadu , Tasneem Selim , Saif Alzubi , Lei Zhang , Ahmed Karam Eldaly , Xujiong Ye

Deep neural networks excel in radiological image classification but frequently suffer from poor interpretability, limiting clinical acceptance. We present MedicalPatchNet, an inherently self-explainable architecture for chest X-ray…

计算机视觉与模式识别 · 计算机科学 2026-02-26 Patrick Wienholt , Christiane Kuhl , Jakob Nikolas Kather , Sven Nebelung , Daniel Truhn

The notion of concept drift refers to the phenomenon that the data generating distribution changes over time; as a consequence machine learning models may become inaccurate and need adjustment. In this paper we consider the problem of…

机器学习 · 计算机科学 2022-05-16 Fabian Hinder , André Artelt , Valerie Vaquet , Barbara Hammer

Understanding how language model capabilities transfer from pretraining to supervised fine-tuning (SFT) is fundamental to efficient model development and data curation. In this work, we investigate four core questions: RQ1. To what extent…

机器学习 · 计算机科学 2026-02-13 Simin Fan , Dimitris Paparas , Natasha Noy , Binbin Xiong , Noveen Sachdeva , Berivan Isik

A trained ML model is deployed on another `test' dataset where target feature values (labels) are unknown. Drift is distribution change between the training and deployment data, which is concerning if model performance changes. For a…

应用统计 · 统计学 2022-09-07 Samuel Ackerman , Eitan Farchi , Orna Raz , Marcel Zalmanovici , Parijat Dube

Remarkable progress has been made in image recognition, primarily due to the availability of large-scale annotated datasets and the revival of deep CNN. CNNs enable learning data-driven, highly representative, layered hierarchical image…

计算机视觉与模式识别 · 计算机科学 2016-02-11 Hoo-Chang Shin , Holger R. Roth , Mingchen Gao , Le Lu , Ziyue Xu , Isabella Nogues , Jianhua Yao , Daniel Mollura , Ronald M. Summers

Explainable Artificial Intelligence (XAI) techniques, such as Gradient-weighted Class Activation Mapping (Grad-CAM), have become indispensable for visualizing the reasoning process of deep neural networks in medical image analysis. Despite…

计算机视觉与模式识别 · 计算机科学 2026-01-21 Teerapong Panboonyuen

Motivation: Traditional image attribution methods struggle to satisfactorily explain predictions of neural networks. Prediction explanation is important, especially in medical imaging, for avoiding the unintended consequences of deploying…

计算机视觉与模式识别 · 计算机科学 2021-04-27 Joseph Paul Cohen , Rupert Brooks , Sovann En , Evan Zucker , Anuj Pareek , Matthew P. Lungren , Akshay Chaudhari

Data in the real world often has an evolving distribution. Thus, machine learning models trained on such data get outdated over time. This phenomenon is called model drift. Knowledge of this drift serves two purposes: (i) Retain an accurate…

机器学习 · 计算机科学 2025-03-11 Pranoy Panda , Kancheti Sai Srinivas , Vineeth N Balasubramanian , Gaurav Sinha

Adapting to latent confounded shift remains a core challenge in modern AI. This setting is driven by hidden variables that induce spurious correlations between inputs and outputs during training, leading models to rely on non-causal…

机器学习 · 计算机科学 2026-05-14 Jialin Yu , Yuxiang Zhou , Haoxuan Li , Junchi Yu , Mengyue Yang , Yulan He , Nevin L. Zhang , Philip Torr , Ricardo Silva

Data drift is the change in model input data that is one of the key factors leading to machine learning models performance degradation over time. Monitoring drift helps detecting these issues and preventing their harmful consequences.…

计算与语言 · 计算机科学 2023-05-30 Ella Rabinovich , Matan Vetzler , Samuel Ackerman , Ateret Anaby-Tavor

In the pursuit of autonomous learning systems, the foundational assumption of stationarity, the premise that data distributions and model behaviors remain constant, is fundamentally untenable. Historically, the research community has…

机器学习 · 计算机科学 2026-05-05 Xiaoyu Yang , En Yu , Jie Lu

Despite the significant potential of Foundation Models (FMs) in medical imaging, their application to prognosis prediction remains challenging due to data scarcity, class imbalance, and task complexity, which limit their clinical adoption.…

计算机视觉与模式识别 · 计算机科学 2026-01-16 Filippo Ruffini , Elena Mulero Ayllon , Linlin Shen , Paolo Soda , Valerio Guarrasi

Pneumonia is a leading cause of mortality in children under five, with over 700,000 deaths annually. Accurate diagnosis from chest X-rays is limited by radiologist availability and variability. Objective: This study compares custom CNNs…

计算机视觉与模式识别 · 计算机科学 2026-01-06 Agniv Roy Choudhury

Deep learning methods for chest X-ray interpretation typically rely on pretrained models developed for ImageNet. This paradigm assumes that better ImageNet architectures perform better on chest X-ray tasks and that ImageNet-pretrained…

计算机视觉与模式识别 · 计算机科学 2021-02-23 Alexander Ke , William Ellsworth , Oishi Banerjee , Andrew Y. Ng , Pranav Rajpurkar