English
Related papers

Related papers: How stable are Transferability Metrics evaluations…

200 papers

Transfer learning is a common practice that alleviates the need for extensive data to train neural networks. It is performed by pre-training a model using a source dataset and fine-tuning it for a target task. However, not every source…

Machine Learning · Computer Science 2024-10-01 Jiseok Lee , Brian Kenji Iwana

Classical machine learning approaches are sensitive to non-stationarity. Transfer learning can address non-stationarity by sharing knowledge from one system to another, however, in areas like machine prognostics and defense, data is…

Machine Learning · Computer Science 2022-09-07 Tyler Cody , Stephen Adams , Peter A. Beling

Estimating model parameters is a crucial step in mathematical modelling and typically involves minimizing the disagreement between model predictions and experimental data. This calibration data can change throughout a study, particularly if…

Quantitative Methods · Quantitative Biology 2023-11-03 Tyler Cassidy

In continual learning, understanding the properties of task sequences and their relationships to model performance is important for developing advanced algorithms with better accuracy. However, efforts in this direction remain…

Machine Learning · Computer Science 2025-02-11 Thinh Nguyen , Cuong N. Nguyen , Quang Pham , Binh T. Nguyen , Savitha Ramasamy , Xiaoli Li , Cuong V. Nguyen

Robustness, the ability of models to maintain performance in the face of perturbations, is critical for developing reliable NLP systems. Recent studies have shown promising results in improving the robustness of models through adversarial…

Artificial Intelligence · Computer Science 2023-11-01 Leiyu Pan , Supryadi , Deyi Xiong

Automatic machine translation metrics typically rely on human translations to determine the quality of system translations. Common wisdom in the field dictates that the human references should be of very high quality. However, there are no…

Computation and Language · Computer Science 2024-04-11 Vilém Zouhar , Ondřej Bojar

We present a new dataset with the goal of advancing image style transfer - the task of rendering one image in the style of another image. The dataset covers various content and style images of different size and contains 10.000 stylizations…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Victor Kitov , Valentin Abramov , Mikhail Akhtyrchenko

Objective: With the rapid rise of wearable sleep monitoring devices with non-conventional electrode configurations, there is a need for automated algorithms that can perform sleep staging on configurations with small amounts of labeled…

Signal Processing · Electrical Eng. & Systems 2022-01-04 Elisabeth R. M. Heremans , Huy Phan , Amir H. Ansari , Pascal Borzée , Bertien Buyse , Dries Testelmans , Maarten De Vos

Prompt tuning has emerged as a lightweight strategy for adapting foundation models to downstream tasks, particularly for resource-constrained systems. As pre-trained prompts become valuable assets, combining multiple source prompts offers a…

Computation and Language · Computer Science 2025-10-16 Enming Zhang , Liwen Cao , Yanru Wu , Zijie Zhao , Yang Li

The emergence of heterogeneity in high-performance computing, which harnesses under one integrated system several platforms of different architectures, also led to the development of innovative cross-platform programming models. Along with…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-26 Ami Marowka

Theoretical works on supervised transfer learning (STL) -- where the learner has access to labeled samples from both source and target distributions -- have for the most part focused on statistical aspects of the problem, while efficient…

Machine Learning · Statistics 2025-07-08 Yuyang Deng , Samory Kpotufe

An ongoing debate in the NLG community concerns the best way to evaluate systems, with human evaluation often being considered the most reliable method, compared to corpus-based metrics. However, tasks involving subtle textual differences,…

Computation and Language · Computer Science 2021-01-06 Lorenzo De Mattei , Michele Cafagna , Huiyuan Lai , Felice Dell'Orletta , Malvina Nissim , Albert Gatt

Software development relies heavily on text-based communication, making sentiment analysis a valuable tool for understanding team dynamics and supporting trustworthy AI-driven analytics in requirements engineering. However, existing…

Software Engineering · Computer Science 2025-07-11 Martin Obaidi , Marc Herrmann , Jil Klünder , Kurt Schneider

We study a fundamental transfer learning process from source to target linear regression tasks, including overparameterized settings where there are more learned parameters than data samples. The target task learning is addressed by using…

Machine Learning · Computer Science 2024-06-03 Yehuda Dar , Daniel LeJeune , Richard G. Baraniuk

Large language models (LLMs) have achieved state-of-the-art performance in various software engineering tasks, including error detection, clone detection, and code translation, primarily leveraging high-resource programming languages like…

Computation and Language · Computer Science 2025-06-11 Razan Baltaji , Saurabh Pujar , Louis Mandel , Martin Hirzel , Luca Buratti , Lav Varshney

Generalist robot policies are trained on demonstrations collected across a wide variety of robots, scenes, and viewpoints. Yet it remains unclear how to best organize and scale such heterogeneous data so that it genuinely improves…

Robotics · Computer Science 2026-03-23 Jonathan Yang , Chelsea Finn , Dorsa Sadigh

As attribution-based explanation methods are increasingly used to establish model trustworthiness in high-stakes situations, it is critical to ensure that these explanations are stable, e.g., robust to infinitesimal perturbations to an…

Recent breakthroughs in NLP research, such as the advent of Transformer models have indisputably contributed to major advancements in several tasks. However, few works research robustness and explainability issues of their evaluation…

Computation and Language · Computer Science 2022-10-31 Maria Lymperaiou , George Manoliadis , Orfeas Menis Mastromichalakis , Edmund G. Dervakos , Giorgos Stamou

Large language models are increasingly deployed across diverse applications. This often includes tasks LLMs have not encountered during training. This implies that enumerating and obtaining the high-quality training data for all tasks is…

Computation and Language · Computer Science 2025-11-11 Shambhavi Krishna , Atharva Naik , Chaitali Agarwal , Sudharshan Govindan , Taesung Lee , Haw-Shiuan Chang

Recent trends in the machine learning community show that models with fidelity toward human perceptual measurements perform strongly on vision tasks. Likewise, human behavioral measurements have been used to regularize model performance.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Justin Dulay , Walter J. Scheirer