English
Related papers

Related papers: When Fine-Tuning Changes the Evidence: Architectur…

200 papers

Soft labels generated by teacher models have become a dominant paradigm for knowledge transfer and recent large-scale dataset distillation such as SRe2L, RDED, LPLD, offering richer supervision than conventional hard labels. However, we…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Jiacheng Cui , Bingkui Tong , Xinyue Bi , Xiaohan Zhao , Jiacheng Liu , Zhiqiang Shen

Concept drift -- the change of the distribution over time -- poses significant challenges for learning systems and is of central interest for monitoring. Understanding drift is thus paramount, and drift localization -- determining which…

Machine Learning · Computer Science 2026-04-22 Fabian Hinder , Valerie Vaquet , Johannes Brinkrolf , Barbara Hammer

Visual embeddings from Convolutional Neural Networks (CNN) trained on the ImageNet dataset for the ILSVRC challenge have shown consistently good performance for transfer learning and are widely used in several tasks, including image…

Information Retrieval · Computer Science 2018-09-26 Felipe del Rio , Pablo Messina , Vicente Dominguez , Denis Parra

Deep learning (DL) has demonstrated its innate capacity to independently learn hierarchical features from complex and multi-dimensional data. A common understanding is that its performance scales up with the amount of training data. Another…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Sivaramakrishnan Rajaraman , Ghada Zamzmi , Feng Yang , Zhaohui Liang , Zhiyun Xue , Sameer Antani

State-of-the-art approaches for the semantic labeling of LiDAR point clouds heavily rely on the use of deep Convolutional Neural Networks (CNNs). However, transferring network architectures across different LiDAR sensor types represents a…

Computer Vision and Pattern Recognition · Computer Science 2019-07-05 Florian Piewak , Peter Pinggera , Marius Zöllner

In Continual Learning (CL) contexts, concept drift typically refers to the analysis of changes in data distribution. A drift in the input data can have negative consequences on a learning predictor and the system's stability. The majority…

Machine Learning · Computer Science 2024-10-23 Sebastian Basterrech

Foundation models are increasingly applied to computational pathology, yet their behavior under cross-cancer and cross-species transfer remains unspecified. This study investigated how fine-tuning CPath-CLIP affects cancer detection under…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Ekansh Arora

Data stream learning has been largely studied for extracting knowledge structures from continuous and rapid data records. In the semantic Web, data is interpreted in ontologies and its ordered sequence is represented as an ontology stream.…

Artificial Intelligence · Computer Science 2017-04-26 Freddy Lecue , Jiaoyan Chen , Jeff Pan , Huajun Chen

In machine learning, concept drift is an evolution of information that invalidates the current data model. It happens when the statistical properties of the input data change over time in unforeseen ways. Concept drift detection is crucial…

Machine Learning · Computer Science 2024-06-21 Honorius Galmeanu , Razvan Andonie

One aim shared by multiple settings, such as continual learning or transfer learning, is to leverage previously acquired knowledge to converge faster on the current task. Usually this is done through fine-tuning, where an implicit…

Machine Learning · Computer Science 2023-10-17 Tudor Berariu , Wojciech Czarnecki , Soham De , Jorg Bornschein , Samuel Smith , Razvan Pascanu , Claudia Clopath

Concept drift, i.e., the change of the data generating distribution, can render machine learning models inaccurate. Several works address the phenomenon of concept drift in the streaming context usually assuming that consecutive data points…

Machine Learning · Computer Science 2023-12-19 Fabian Hinder , Valerie Vaquet , Barbara Hammer

Biases can filter into AI technology without our knowledge. Oftentimes, seminal deep learning networks champion increased accuracy above all else. In this paper, we attempt to alleviate biases encountered by semantic segmentation models in…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Jack Stelling , Amir Atapour-Abarghouei

It is an open secret that ImageNet is treated as the panacea of pretraining. Particularly in medical machine learning, models not trained from scratch are often finetuned based on ImageNet-pretrained models. We posit that pretraining on…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Frederic Jonske , Moon Kim , Enrico Nasca , Janis Evers , Johannes Haubold , René Hosch , Felix Nensa , Michael Kamp , Constantin Seibold , Jan Egger , Jens Kleesiek

BACKGROUND AND OBJECTIVES: The multiple chest x-ray datasets released in the last years have ground-truth labels intended for different computer vision tasks, suggesting that performance in automated chest-xray interpretation might improve…

The capacity to transfer knowledge across scientific domains relies on shared organizational principles. However, existing transfer-learning methodologies often fail to bridge radically heterogeneous systems, particularly under severe data…

Machine Learning · Computer Science 2026-02-12 Daniele Caligiore

We demonstrate that self-learning techniques like entropy minimization and pseudo-labeling are simple and effective at improving performance of a deployed computer vision model under systematic domain shifts. We conduct a wide range of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Evgenia Rusak , Steffen Schneider , George Pachitariu , Luisa Eck , Peter Gehler , Oliver Bringmann , Wieland Brendel , Matthias Bethge

The robustness of machine learning models can be compromised by spurious correlations between non-causal features in the input data and target labels. A common way to test for such correlations is to train on data where the label is…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Akshit Achara , Yovin Yathathugoda , Nick Byrne , Michela Antonelli , Esther Puyol Anton , Alexander Hammers , Andrew P. King

Transfer learning aims at building robust prediction models by transferring knowledge gained from one problem to another. In the semantic Web, learning tasks are enhanced with semantic representations. We exploit their semantics to augment…

Machine Learning · Computer Science 2019-06-25 Freddy Lecue , Jiaoyan Chen , Jeff Z. Pan , Huajun Chen

The possibility of high-precision and rapid detection of pathologies on chest X-rays makes it possible to detect the development of pneumonia at an early stage and begin immediate treatment. Artificial intelligence can speed up and…

Image and Video Processing · Electrical Eng. & Systems 2023-03-21 Kolesnikov Dmitry

Deep neural networks for medical image diagnosis often achieve high predictive accuracy while relying on spurious or clinically irrelevant visual cues, limiting their trustworthiness in practice. Post-hoc explanation methods are widely used…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zubair Faruqui , Rahul Dubey