English
Related papers

Related papers: Post-Transfer Learning Statistical Inference in Hi…

200 papers

Aided target recognition (AiTR), the problem of classifying objects from sensor data, is an important problem with applications across industry and defense. While classification algorithms continue to improve, they often require more…

Computer Vision and Pattern Recognition · Computer Science 2020-11-26 Samuel Rivera , Olga Mendoza-Schrock , Ashley Diehl

Deep text matching approaches have been widely studied for many applications including question answering and information retrieval systems. To deal with a domain that has insufficient labeled data, these approaches can be used in a…

Information Retrieval · Computer Science 2019-01-01 Chen Qu , Feng Ji , Minghui Qiu , Liu Yang , Zhiyu Min , Haiqing Chen , Jun Huang , W. Bruce Croft

Many machine learning and data mining algorithms rely on the assumption that the training and testing data share the same feature space and distribution. However, this assumption may not always hold. For instance, there are situations where…

Cryptography and Security · Computer Science 2024-03-05 Adrian Shuai Li , Arun Iyengar , Ashish Kundu , Elisa Bertino

This paper presents a selective survey of recent developments in statistical inference and multiple testing for high-dimensional regression models, including linear and logistic regression. We examine the construction of confidence…

Methodology · Statistics 2023-01-26 T. Tony Cai , Zijian Guo , Yin Xia

The application of transfer learning, leveraging knowledge from source domains to enhance model performance in a target domain, has significantly grown, supporting diverse real-world applications. Its success often relies on shared…

Machine Learning · Computer Science 2024-07-19 Runxue Bao , Yiming Sun , Yuhe Gao , Jindong Wang , Qiang Yang , Zhi-Hong Mao , Ye Ye

We propose a transfer learning method that utilizes data representations in a semiparametric regression model. Our aim is to perform statistical inference on the parameter of primary interest in the target model while accounting for…

Methodology · Statistics 2024-06-21 Baihua He , Huihang Liu , Xinyu Zhang , Jian Huang

Transfer learning (TL) leverages previously obtained knowledge to learn new tasks efficiently and has been used to train deep learning (DL) models with limited amount of data. When TL is applied to DL, pretrained (teacher) models are…

In this paper, we introduce Traversal Learning (TL), a novel approach designed to address the problem of decreased quality encountered in popular distributed learning (DL) paradigms such as Federated Learning (FL), Split Learning (SL), and…

Machine Learning · Computer Science 2025-09-11 Erdenebileg Batbaatar , Jeonggeol Kim , Yongcheol Kim , Young Yoon

In many real-world applications of deep learning, estimation of a target may rely on various types of input data modes, such as audio-video, image-text, etc. This task can be further complicated by a lack of sufficient data. Here we propose…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Levi McClenny , Mulugeta Haile , Vahid Attari , Brian Sadler , Ulisses Braga-Neto , Raymundo Arroyave

In this work, we study the transfer learning problem under high-dimensional generalized linear models (GLMs), which aim to improve the fit on target data by borrowing information from useful source data. Given which sources to transfer, we…

Machine Learning · Statistics 2022-04-19 Ye Tian , Yang Feng

Hyperparameter selection is a critical step in the deployment of artificial intelligence (AI) models, particularly in the current era of foundational, pre-trained, models. By framing hyperparameter selection as a multiple hypothesis testing…

Machine Learning · Computer Science 2025-02-07 Amirmohammad Farzaneh , Osvaldo Simeone

Transfer learning, also referred as knowledge transfer, aims at reusing knowledge from a source dataset to a similar target one. While many empirical studies illustrate the benefits of transfer learning, few theoretical results are…

Statistics Theory · Mathematics 2021-02-19 David Obst , Badih Ghattas , Jairo Cugliari , Georges Oppenheim , Sandra Claudel , Yannig Goude

Machine learning (ML) accelerates the exploration of material properties and their links to the structure of the underlying molecules. In previous work [J. Shi, M. J. Quevillon, P. H. A. Valen\c{c}a, and J. K. Whitmer, \textit{ACS Appl.…

Soft Condensed Matter · Physics 2023-01-06 Jiale Shi , Fahed Albreiki , Yamil J. Colón , Samanvaya Srivastava , Jonathan K. Whitmer

Transfer learning has become an essential technique for utilizing information from source datasets to improve the performance of the target task. However, in the context of high-dimensional data, heterogeneity arises due to heteroscedastic…

Methodology · Statistics 2024-06-26 Xiaohui Yuan , Shujie Ren

Hyperspectral image (HSI) classification presents inherent challenges due to high spectral dimensionality, significant domain shifts, and limited availability of labeled data. To address these issues, we propose a novel Active Transfer…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Muhammad Ahmad , Francesco Mauro , Manuel Mazzara , Salvatore Distefano , Adil Mehmood Khan , Silvia Liberata Ullo

Reinforcement learning (RL) is concerned with how intelligence agents take actions in a given environment to maximize the cumulative reward they receive. In healthcare, applying RL algorithms could assist patients in improving their health…

Machine Learning · Statistics 2025-04-21 Chengchun Shi

Accurate forecasting of recovery rates (RR) is central to credit risk management and regulatory capital determination. In many loan portfolios, however, RR modeling is constrained by data scarcity arising from infrequent default events.…

Risk Management · Quantitative Finance 2026-04-24 Christopher Gerling , Hanqiu Peng , Ying Chen , Stefan Lessmann

Transfer learning techniques aim to leverage information from multiple related datasets to enhance prediction quality against a target dataset. Such methods have been adopted in the context of high-dimensional sparse regression, and some…

Machine Learning · Statistics 2025-01-31 Koki Okajima , Tomoyuki Obuchi

Sparse sensor array selection arises in many engineering applications, where it is imperative to obtain maximum spatial resolution from a limited number of array elements. Recent research shows that computational complexity of array…

Signal Processing · Electrical Eng. & Systems 2020-06-03 Ahmet M. Elbir , Kumar Vijay Mishra

Deep learning algorithms provide a new paradigm to study high-dimensional dynamical behaviors, such as those in fusion plasma systems. Development of novel model reduction methods, coupled with detection of abnormal modes with plasma…

Computational Physics · Physics 2024-04-29 Zhe Bai , Xishuo Wei , William Tang , Leonid Oliker , Zhihong Lin , Samuel Williams