English
Related papers

Related papers: Augmented Transfer Regression Learning with Semi-n…

200 papers

We propose a novel mechanism for real-time (human-in-the-loop) feedback focused on false positive reduction to enhance anomaly detection models. It was designed for the lightweight deployment of a behavioral network anomaly detection model.…

Machine Learning · Computer Science 2025-02-28 Sam Pastoriza , Iman Yousfi , Christopher Redino , Marc Vucovich , Abdul Rahman , Sal Aguinaga , Dhruv Nandakumar

Transfer learning on tabular data is challenging due to disparate feature spaces across domains, in contrast to the homogeneous structures of image and text. Large language models (LLMs) offer a knowledge base to improve the limited…

Machine Learning · Computer Science 2026-01-26 Ibna Kowsar , Kazi F. Akhter , Manar D. Samad

In networks of independent entities that face similar predictive tasks, transfer machine learning enables to re-use and improve neural nets using distributed data sets without the exposure of raw data. As the number of data sets in business…

Machine Learning · Computer Science 2020-03-31 Robin Hirt , Akash Srivastava , Carlos Berg , Niklas Kühl

More music foundation models are recently being released, promising a general, mostly task independent encoding of musical information. Common ways of adapting music foundation models to downstream tasks are probing and fine-tuning. These…

Sound · Computer Science 2024-12-02 Yiwei Ding , Alexander Lerch

Current methods for covariate-shift adaptation use unlabelled data to compute importance weights or domain-invariant features, while the final model is trained on labelled data only. Here, we consider a particular case of covariate shift…

Machine Learning · Statistics 2019-02-28 Julius von Kügelgen , Alexander Mey , Marco Loog

Label assignment is a crucial process in object detection, which significantly influences the detection performance by determining positive or negative samples during training process. However, existing label assignment strategies barely…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Jian Guan , Mingjie Xie , Youtian Lin , Guangjun He , Pengming Feng

Estimation of average treatment effects on the treated (ATT) is an important topic of causal inference in econometrics and statistics. This problem seems to be often treated as a simple modification or extension of that of estimating…

Methodology · Statistics 2018-08-07 Heng Shu , Zhiqiang Tan

Target localization is a critical task in sensitive applications, where multiple sensing agents communicate and collaborate to identify the target location based on sensor readings. Existing approaches investigated the use of Multi-Agent…

Machine Learning · Computer Science 2025-01-22 Ahmed Alagha , Rabeb Mizouni , Shakti Singh , Jamal Bentahar , Hadi Otrok

Transfer learning aims at transferring knowledge from a well-labeled domain to a similar but different domain with limited or no labels. Unfortunately, existing learning-based methods often involve intensive model selection and…

Machine Learning · Computer Science 2019-04-11 Jindong Wang , Yiqiang Chen , Han Yu , Meiyu Huang , Qiang Yang

In randomized experiments, regression adjustment can improve the precision of average treatment effect (ATE) estimation using covariates without requiring a correctly specified outcome model. Although well studied in low-dimensional…

Statistics Theory · Mathematics 2026-04-28 Dogyoon Song

This paper studies transfer learning for ridge-regularized robust linear regression in the moderate-dimensional regime, where the number of predictors is of the same order as the sample size and the regression coefficients are not assumed…

Methodology · Statistics 2026-04-14 Lingfeng Lyu , Xiao Guo , Zongqi Liu

The method of instrumental variables provides a fundamental and practical tool for causal inference in many empirical studies where unmeasured confounding between the treatments and the outcome is present. Modern data such as the genetical…

Methodology · Statistics 2022-10-28 Ziang Niu , Yuwen Gu , Wei Li

Transfer learning aims to faciliate learning tasks in a label-scarce target domain by leveraging knowledge from a related source domain with plenty of labeled data. Often times we may have multiple domains with little or no labeled data as…

Machine Learning · Computer Science 2017-11-10 Tianchun Wang

Transfer learning (TL) leverages previously obtained knowledge to learn new tasks efficiently and has been used to train deep learning (DL) models with limited amount of data. When TL is applied to DL, pretrained (teacher) models are…

We propose some extensions to semi-parametric models based on Bayesian additive regression trees (BART). In the semi-parametric BART paradigm, the response variable is approximated by a linear predictor and a BART model, where the linear…

Machine Learning · Statistics 2026-03-10 Estevão B. Prado , Andrew C. Parnell , Keefe Murphy , Nathan McJames , Ann O'Shea , Rafael A. Moral

Adapting pre-trained neural models to downstream tasks has become the standard practice for obtaining high-quality models. In this work, we propose a novel model adaptation paradigm, adapting by pruning, which prunes neural connections in…

Machine Learning · Computer Science 2021-05-10 Yang Gao , Nicolo Colombo , Wei Wang

Transfer learning is a powerful paradigm for leveraging knowledge from source domains to enhance learning in a target domain. However, traditional transfer learning approaches often focus on scalar or multivariate data within Euclidean…

Machine Learning · Computer Science 2025-10-24 Kaicheng Zhang , Sinian Zhang , Doudou Zhou , Yidong Zhou

We consider nonparametric regression under covariate shift, where we observe samples from both the target distribution and a related but distinct source distribution. We introduce a novel object, the transfer function, and show that…

Statistics Theory · Mathematics 2026-03-09 Petr Zamolodtchikov

It is widely admitted that structured nonparametric modeling that circumvents the curse of dimensionality is important in nonparametric estimation. In this paper we show that the same holds for semi-parametric estimation. We argue that…

Statistics Theory · Mathematics 2011-04-25 Kyusang Yu , Enno Mammen , Byeong U. Park

Transfer learning enhances prediction accuracy on a target distribution by leveraging data from a source distribution, demonstrating significant benefits in various applications. This paper introduces a novel dissimilarity measure that…

Machine Learning · Statistics 2024-12-12 Mitsuhiro Fujikawa , Yohei Akimoto , Jun Sakuma , Kazuto Fukuchi