English
Related papers

Related papers: Optimal Transfer Learning for Missing Not-at-Rando…

200 papers

Transfer learning for nonparametric regression is considered. We first study the non-asymptotic minimax risk for this problem and develop a novel estimator called the confidence thresholding estimator, which is shown to achieve the minimax…

Machine Learning · Statistics 2024-01-24 T. Tony Cai , Hongming Pu

In recent years, transfer learning has garnered significant attention. Its ability to leverage knowledge from related studies to improve generalization performance in a target study has made it highly appealing. This paper focuses on…

Machine Learning · Statistics 2025-10-30 Chao Wang , Caixing Wang , Xin He , Xingdong Feng

Matrix completion is one of the key problems in signal processing and machine learning, with applications ranging from image pro- cessing and data gathering to classification and recommender sys- tems. Recently, deep neural networks have…

Machine Learning · Statistics 2018-05-15 Duc Minh Nguyen , Evaggelia Tsiligianni , Nikos Deligiannis

Conditions ensuring optimal parameter estimation in the presence of missing data are well established in inference, typically relying on the Missing-at-Random (MAR) assumption. In prediction, similar principles are often assumed to apply.…

Methodology · Statistics 2026-03-19 Pierre Catoire , Robin Genuer , Cecile Proust-Lima

Rates of missing data often depend on record-keeping policies and thus may change across times and locations, even when the underlying features are comparatively stable. In this paper, we introduce the problem of Domain Adaptation under…

Machine Learning · Computer Science 2023-05-05 Helen Zhou , Sivaraman Balakrishnan , Zachary C. Lipton

Effective resource management plays a pivotal role in wireless networks, which, unfortunately, results in challenging mixed-integer nonlinear programming (MINLP) problems in most cases. Machine learning-based methods have recently emerged…

Signal Processing · Electrical Eng. & Systems 2019-05-17 Yifei Shen , Yuanming Shi , Jun Zhang , Khaled B. Letaief

Deep learning models require a large amount of data to perform well. When data is scarce for a target task, we can transfer the knowledge gained by training on similar tasks to quickly learn the target. A successful approach is…

Machine Learning · Computer Science 2021-03-18 Alberto Bernacchia

Motivated by the least squares solver Blendenpik, we investigate three strategies for uniform sampling of rows from m x n matrices Q with orthonormal columns. The goal is to determine, with high probability, how many rows are required so…

Numerical Analysis · Mathematics 2014-03-06 Ilse C. F. Ipsen , Thomas Wentworth

Active learning is widely used to reduce labeling effort and training time by repeatedly querying only the most beneficial samples from unlabeled data. In real-world problems where data cannot be stored indefinitely due to limited storage…

Machine Learning · Computer Science 2021-07-13 Taehyeong Kim , Injune Hwang , Hyundo Lee , Hyunseo Kim , Won-Seok Choi , Joseph J. Lim , Byoung-Tak Zhang

We study the problem of testing whether the missing values of a potentially high-dimensional dataset are Missing Completely at Random (MCAR). We relax the problem of testing MCAR to the problem of testing the compatibility of a collection…

Statistics Theory · Mathematics 2024-12-13 Alberto Bordino , Thomas B. Berrett

Memory-based meta-learning is a technique for approximating Bayes-optimal predictors. Under fairly general conditions, minimizing sequential prediction error, measured by the log loss, leads to implicit meta-learning. The goal of this work…

Tensors are widely used to represent multiway arrays of data. The recovery of missing entries in a tensor has been extensively studied, generally under the assumption that entries are missing completely at random (MCAR). However, in most…

Machine Learning · Statistics 2021-04-23 Chengrun Yang , Lijun Ding , Ziyang Wu , Madeleine Udell

The problem of structured matrix estimation has been studied mostly under strong noise dependence assumptions. This paper considers a general framework of noisy low-rank-plus-sparse matrix recovery, where the noise matrix may come from any…

Machine Learning · Statistics 2025-04-07 Jinhang Chai , Jianqing Fan

In this paper, we consider the streaming memory-limited matrix completion problem when the observed entries are noisy versions of a small random fraction of the original entries. We are interested in scenarios where the matrix size is very…

Spectral Theory · Mathematics 2015-04-14 Se-Young Yun , Marc Lelarge , Alexandre Proutiere

We propose an efficient family of algorithms to learn the parameters of a Bayesian network from incomplete data. In contrast to textbook approaches such as EM and the gradient method, our approach is non-iterative, yields closed form…

Machine Learning · Computer Science 2014-11-26 Guy Van den Broeck , Karthika Mohan , Arthur Choi , Judea Pearl

Learning systems often expand their ambient features or latent representations over time, embedding earlier representations into larger spaces with limited new latent structure. We study transfer learning for structured matrix estimation…

Machine Learning · Computer Science 2026-01-30 Jinhang Chai , Xuyuan Liu , Elynn Chen , Yujun Yan

Machine learning techniques have been developed to learn from complete data. When missing values exist in a dataset, the incomplete data should be preprocessed separately by removing data points with missing values or imputation. In this…

Machine Learning · Computer Science 2020-12-25 Hadi A. Khorshidi , Michael Kirley , Uwe Aickelin

Neural machine translation is known to require large numbers of parallel training sentences, which generally prevent it from excelling on low-resource language pairs. This thesis explores the use of cross-lingual transfer learning on neural…

Computation and Language · Computer Science 2020-01-07 Tom Kocmi

Missing data is a crucial issue when applying machine learning algorithms to real-world datasets. Starting from the simple assumption that two batches extracted randomly from the same dataset should share the same distribution, we leverage…

Machine Learning · Statistics 2020-07-02 Boris Muzellec , Julie Josse , Claire Boyer , Marco Cuturi

The problem of finding the missing values of a matrix given a few of its entries, called matrix completion, has gathered a lot of attention in the recent years. Although the problem under the standard low rank assumption is NP-hard,…

Machine Learning · Computer Science 2014-12-01 Vassilis Kalofolias , Xavier Bresson , Michael Bronstein , Pierre Vandergheynst