English
Related papers

Related papers: Harnessing the Power of Vicinity-Informed Analysis…

200 papers

Transfer learning involves taking information and insight from one problem domain and applying it to a new problem domain. Although widely used in practice, theory for transfer learning remains less well-developed. To address this, we prove…

Machine Learning · Statistics 2020-06-24 Jake Williams , Abel Tadesse , Tyler Sam , Huey Sun , George D. Montanez

We propose a method for transfer learning in nonparametric regression using a random forest (RF) with distance covariance-based feature weights, assuming the unknown source and target regression functions are sparsely different. Our method…

Machine Learning · Statistics 2026-03-17 Chenze Li , Subhadeep Paul

The application of machine learning models can be significantly impeded by the occurrence of distributional shifts, as the assumption of homogeneity between the population of training and testing samples in machine learning and statistics…

Machine Learning · Statistics 2023-06-06 Wenlu Tang , Zicheng Liu

Transfer learning aims to learn robust classifiers for the target domain by leveraging knowledge from a source domain. Since the source and the target domains are usually from different distributions, existing methods mainly focus on…

Machine Learning · Computer Science 2019-09-19 Jindong Wang , Yiqiang Chen , Wenjie Feng , Han Yu , Meiyu Huang , Qiang Yang

Standard supervised machine learning assumes that the distribution of the source samples used to train an algorithm is the same as the one of the target samples on which it is supposed to make predictions. However, as any data scientist…

Machine Learning · Computer Science 2020-02-12 Pirmin Lemberger , Ivan Panico

Reliable uncertainty estimates are an important tool for helping autonomous agents or human decision makers understand and leverage predictive models. However, existing approaches to estimating uncertainty largely ignore the possibility of…

Machine Learning · Computer Science 2020-05-22 Sangdon Park , Osbert Bastani , James Weimer , Insup Lee

An open scientific challenge is how to classify events with reliable measures of uncertainty, when we have a mechanistic model of the data-generating process but the distribution over both labels and latent nuisance parameters is different…

Machine Learning · Statistics 2024-07-02 Luca Masserano , Alex Shen , Michele Doro , Tommaso Dorigo , Rafael Izbicki , Ann B. Lee

Collaborative filtering (CF) aims to predict users' ratings on items according to historical user-item preference data. In many real-world applications, preference data are usually sparse, which would make models overfit and fail to give…

Machine Learning · Computer Science 2012-10-29 Zhongqi Lu , Erheng Zhong , Lili Zhao , Wei Xiang , Weike Pan , Qiang Yang

Time Series Classification (TSC) has been an important and challenging task in data mining, especially on multivariate time series and multi-view time series data sets. Meanwhile, transfer learning has been widely applied in computer vision…

Machine Learning · Computer Science 2019-10-18 Donglin Zhan , Shiyu Yi , Dongli Xu , Xiao Yu , Denglin Jiang , Siqi Yu , Haoting Zhang , Wenfang Shangguan , Weihua Zhang

In this paper, we propose a novel self-supervised transfer learning method called \underline{\textbf{D}}istribution \underline{\textbf{M}}atching (DM), which drives the representation distribution toward a predefined reference distribution…

Machine Learning · Statistics 2025-07-03 Yuling Jiao , Wensen Ma , Defeng Sun , Hansheng Wang , Yang Wang

The training of deep-learning-based text classification models relies heavily on a huge amount of annotation data, which is difficult to obtain. When the labeled data is scarce, models tend to struggle to achieve satisfactory performance.…

Computation and Language · Computer Science 2020-04-07 Dianbo Sui , Yubo Chen , Binjie Mao , Delai Qiu , Kang Liu , Jun Zhao

We demonstrate that self-learning techniques like entropy minimization and pseudo-labeling are simple and effective at improving performance of a deployed computer vision model under systematic domain shifts. We conduct a wide range of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Evgenia Rusak , Steffen Schneider , George Pachitariu , Luisa Eck , Peter Gehler , Oliver Bringmann , Wieland Brendel , Matthias Bethge

We consider the problem of estimating the class prior in an unlabeled dataset. Under the assumption that an additional labeled dataset is available, the class prior can be estimated by fitting a mixture of class-wise data distributions to…

Machine Learning · Computer Science 2016-11-08 Marthinus C. du Plessis , Gang Niu , Masashi Sugiyama

In the robotics literature, different knowledge transfer approaches have been proposed to leverage the experience from a source task or robot -- real or virtual -- to accelerate the learning process on a new task or robot. A commonly made…

Robotics · Computer Science 2020-03-31 Michael J. Sorocky , Siqi Zhou , Angela P. Schoellig

A basic condition for efficient transfer learning is the similarity between a target model and source models. In practice, however, the similarity condition is difficult to meet or is even violated. Instead of the similarity condition, a…

Machine Learning · Statistics 2022-06-14 Lu Lin , Weiyu Li

In this work, we propose a simple yet effective semi-supervised learning approach called Augmented Distribution Alignment. We reveal that an essential sampling bias exists in semi-supervised learning due to the limited number of labeled…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Qin Wang , Wen Li , Luc Van Gool

Transfer learning plays a key role in modern data analysis when: (1) the target data are scarce but the source data are sufficient; (2) the distributions of the source and target data are heterogeneous. This paper develops an interpretable…

Machine Learning · Statistics 2024-01-31 Shuo Shuo Liu

To address the challenge of utilizing patient data from other organ transplant centers (source cohorts) to improve survival time estimation and inference for a target center (target cohort) with limited samples and strict data-sharing…

Methodology · Statistics 2025-03-25 Hua Liu , Jiaqi Men , Shouxia Wang , Jinhong You , Jiguo Cao

We investigate sample-based learning of conditional distributions on multi-dimensional unit boxes, allowing for different dimensions of the feature and target spaces. Our approach involves clustering data near varying query points in the…

Machine Learning · Statistics 2024-06-14 Cyril Bénézet , Ziteng Cheng , Sebastian Jaimungal

In this paper, a new approach for classification of target task using limited labeled target data as well as enormous unlabeled source data is proposed which is called self-taught learning. The target and source data can be drawn from…

Computer Vision and Pattern Recognition · Computer Science 2017-10-13 Parvin Razzaghi