English
Related papers

Related papers: Post-Transfer Learning Statistical Inference in Hi…

200 papers

Distance metric learning (DML) aims to find an appropriate way to reveal the underlying data relationship. It is critical in many machine learning, pattern recognition and data mining algorithms, and usually require large amount of label…

Machine Learning · Statistics 2018-11-13 Yong Luo , Yonggang Wen , Ling-Yu Duan , Dacheng Tao

In activity recognition, it is often expensive and time-consuming to acquire sufficient activity labels. To solve this problem, transfer learning leverages the labeled samples from the source domain to annotate the target domain which has…

Computer Vision and Pattern Recognition · Computer Science 2018-01-04 Jindong Wang , Yiqiang Chen , Lisha Hu , Xiaohui Peng , Philip S. Yu

Transfer learning enhances learning across tasks, by leveraging previously learned representations -- if they are properly chosen. We describe an efficient method to accurately estimate the appropriateness of a previously trained model for…

Distance metric learning (DML) plays a crucial role in diverse machine learning algorithms and applications. When the labeled information in target domain is limited, transfer metric learning (TML) helps to learn the metric by leveraging…

Machine Learning · Statistics 2019-04-09 Yong Luo , Yonggang Wen , Dacheng Tao

Representation learning has been a critical topic in machine learning. In Click-through Rate Prediction, most features are represented as embedding vectors and learned simultaneously with other parameters in the model. With the development…

Information Retrieval · Computer Science 2023-02-07 Fuyuan Lyu , Xing Tang , Dugang Liu , Haolun Wu , Chen Ma , Xiuqiang He , Xue Liu

We introduce adaptive learn-then-test (aLTT), an efficient hyperparameter selection procedure that provides finite-sample statistical guarantees on the population risk of AI models. Unlike the existing learn-then-test (LTT) technique, which…

Machine Learning · Statistics 2025-02-03 Matteo Zecchin , Sangwoo Park , Osvaldo Simeone

Recent studies on few-shot classification using transfer learning pose challenges to the effectiveness and efficiency of episodic meta-learning algorithms. Transfer learning approaches are a natural alternative, but they are restricted to…

Machine Learning · Computer Science 2022-05-03 Kuilin Chen , Chi-Guhn Lee

Transfer learning aims to learn classifiers for a target domain by transferring knowledge from a source domain. However, due to two main issues: feature discrepancy and distribution divergence, transfer learning can be a very difficult…

Machine Learning · Computer Science 2022-09-05 Md Geaur Rahman , Md Zahidul Islam

Despite remarkable successes, deep reinforcement learning algorithms remain sample inefficient: they require an enormous amount of trial and error to find good policies. Model-based algorithms promise sample efficiency by building an…

Machine Learning · Computer Science 2023-05-19 Remo Sasso , Michelangelo Conserva , Paulo Rauber

Long-Tailed Semi-Supervised Learning (LTSSL) aims to learn from class-imbalanced data where only a few samples are annotated. Existing solutions typically require substantial cost to solve complex optimization problems, or class-balanced…

Machine Learning · Computer Science 2022-05-27 Tong Wei , Qian-Yu Liu , Jiang-Xin Shi , Wei-Wei Tu , Lan-Zhe Guo

Deep reinforcement learning (RL) is a powerful approach to complex decision making. However, one issue that limits its practical application is its brittleness, sometimes failing to train in the presence of small changes in the environment.…

Machine Learning · Computer Science 2025-01-27 Jung-Hoon Cho , Vindula Jayawardana , Sirui Li , Cathy Wu

Transfer learning aims at transferring knowledge from a well-labeled domain to a similar but different domain with limited or no labels. Unfortunately, existing learning-based methods often involve intensive model selection and…

Machine Learning · Computer Science 2019-04-11 Jindong Wang , Yiqiang Chen , Han Yu , Meiyu Huang , Qiang Yang

Plant phenotyping (Guo et al. 2021; Pieruschka et al. 2019) focuses on studying the diverse traits of plants related to the plants' growth. To be more specific, by accurately measuring the plant's anatomical, ontogenetical, physiological…

Machine Learning · Computer Science 2022-01-17 Jun Wu , Elizabeth A. Ainsworth , Sheng Wang , Kaiyu Guan , Jingrui He

Saliency methods are used extensively to highlight the importance of input features in model predictions. These methods are mostly used in vision and language tasks, and their applications to time series data is relatively unexplored. In…

Machine Learning · Computer Science 2020-10-28 Aya Abdelsalam Ismail , Mohamed Gunady , Héctor Corrada Bravo , Soheil Feizi

This paper proposes new methodologies for conducting practical differentially private (DP) estimation and inference in high-dimensional linear regression. We first introduce a DP Bayesian Information Criterion (DP-BIC) for selecting the…

Methodology · Statistics 2026-04-13 Zhanrui Cai , Sai Li , Xintao Xia , Linjun Zhang

Discrete diffusion models (DMs) have achieved strong performance in language and other discrete domains, offering a compelling alternative to autoregressive modeling. Yet this performance typically depends on large training datasets,…

Machine Learning · Computer Science 2026-04-16 Julian Kleutgens , Claudio Battiloro , Lingkai Kong , Benjamin Grewe , Francesca Dominici , Mauricio Tec

Temporal-Difference (TD) learning is a general and very useful tool for estimating the value function of a given policy, which in turn is required to find good policies. Generally speaking, TD learning updates states whenever they are…

Machine Learning · Computer Science 2021-08-24 Nishanth Anand , Doina Precup

The idea of transfer in reinforcement learning (TRL) is intriguing: being able to transfer knowledge from one problem to another problem without learning everything from scratch. This promises quicker learning and learning more complex…

Machine Learning · Computer Science 2022-01-13 Matthias Müller-Brockhausen , Mike Preuss , Aske Plaat

Multi-task learning (MTL) is frequently used in settings where a target task has to be learnt based on limited training data, but knowledge can be leveraged from related auxiliary tasks. While MTL can improve task performance overall…

Machine Learning · Computer Science 2020-12-18 Rafael Peres da Silva , Chayaporn Suphavilai , Niranjan Nagarajan

Large language models have demonstrated capabilities in text generation, while their increasing parameter scales present challenges in computational and memory efficiency. Post-training sparsity (PTS), which reduces model cost by removing…

Computation and Language · Computer Science 2026-02-26 Minhao Jiang , Zhikai Li , Xuewen Liu , Jing Zhang , Mengjuan Chen , Qingyi Gu