English
Related papers

Related papers: Proxy-informed Bayesian transfer learning with unk…

200 papers

Supervised, semi-supervised, and unsupervised learning estimate a function given input/output samples. Generalization of the learned function to unseen data can be improved by incorporating side information into learning. Side information…

Machine Learning · Computer Science 2016-02-11 Rico Jonschkowski , Sebastian Höfer , Oliver Brock

Prompt tuning offers a parameter-efficient way to adapt large pre-trained language models to new tasks, but most existing approaches are designed for single-task settings, failing to share knowledge across related tasks. We propose…

Computation and Language · Computer Science 2025-09-19 Ahmad Pouramini , Hesham Faili

Data dispersed across multiple files are commonly integrated through probabilistic linkage methods, where even minimal error rates in record matching can significantly contaminate subsequent statistical analyses. In regression problems, we…

Statistics Theory · Mathematics 2024-09-18 Abhisek Chakraborty , Saptati Datta

Learning methods using synthetic data have attracted attention as an effective approach for increasing the diversity of training data while reducing collection costs, thereby improving the robustness of model discrimination. However, many…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Koshiro Nagano , Ryo Fujii , Ryo Hachiuma , Fumiaki Sato , Taiki Sekii , Hideo Saito

Proximal causal inference is a recently proposed framework for evaluating causal effects in the presence of unmeasured confounding. For point identification of causal effects, it leverages a pair of so-called treatment and outcome…

Methodology · Statistics 2024-01-30 AmirEmad Ghassami , Ilya Shpitser , Eric Tchetgen Tchetgen

Bayesian persuasion studies how an informed sender should partially disclose information to influence the behavior of a self-interested receiver. Classical models make the stringent assumption that the sender knows the receiver's utility.…

Computer Science and Game Theory · Computer Science 2021-06-14 Matteo Castiglioni , Alberto Marchesi , Andrea Celli , Nicola Gatti

Multimodal Continual Instruction Tuning (MCIT) enables Multimodal Large Language Models (MLLMs) to meet continuously emerging requirements without expensive retraining. MCIT faces two major obstacles: catastrophic forgetting (where old…

Machine Learning · Computer Science 2024-06-28 Junhao Zheng , Qianli Ma , Zhen Liu , Binquan Wu , Huawen Feng

Implicit feedback (e.g., clicks, dwell times, etc.) is an abundant source of data in human-interactive systems. While implicit feedback has many advantages (e.g., it is inexpensive to collect, user centric, and timely), its inherent biases…

Information Retrieval · Computer Science 2016-08-17 Thorsten Joachims , Adith Swaminathan , Tobias Schnabel

The prior distribution for the unknown model parameters plays a crucial role in the process of statistical inference based on Bayesian methods. However, specifying suitable priors is often difficult even when detailed prior knowledge is…

Methodology · Statistics 2020-03-18 Marcelo Hartmann , Georgi Agiashvili , Paul Bürkner , Arto Klami

In many scientific domains, including experimentation, researchers rely on measurements of proxy outcomes to achieve faster and more frequent reads, especially when the primary outcome of interest is challenging to measure directly. While…

Methodology · Statistics 2026-05-08 Steven Wilkins-Reeves , Alexandra N. M. Darmon , Deeksha Sinha

In this paper, we aim to adapt a model at test-time using a few unlabeled data to address distribution shifts. To tackle the challenges of extracting domain knowledge from a limited amount of data, it is crucial to utilize correlated…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Zhixiang Chi , Li Gu , Tao Zhong , Huan Liu , Yuanhao Yu , Konstantinos N Plataniotis , Yang Wang

The ability to transfer adversarial attacks from one model (the surrogate) to another model (the victim) has been an issue of concern within the machine learning (ML) community. The ability to successfully evade unseen models represents an…

Machine Learning · Computer Science 2021-09-28 Luke E. Richards , André Nguyen , Ryan Capps , Steven Forsythe , Cynthia Matuszek , Edward Raff

Transferring knowledge from prior source tasks in solving a new target task can be useful in several learning applications. The application of transfer poses two serious challenges which have not been adequately addressed. First, the agent…

Artificial Intelligence · Computer Science 2020-09-23 Janarthanan Rajendran , Aravind Srinivas , Mitesh M. Khapra , P Prasanna , Balaraman Ravindran

Deep transfer learning techniques try to tackle the limitations of deep learning, the dependency on extensive training data and the training costs, by reusing obtained knowledge. However, the current DTL techniques suffer from either…

Machine Learning · Computer Science 2023-05-12 Mohammadreza Iman , John A. Miller , Khaled Rasheed , Robert M. Branch , Hamid R. Arabnia

In recent years, graph prompting has emerged as a promising research direction, enabling the learning of additional tokens or subgraphs appended to the original graphs without requiring retraining of pre-trained graph models across various…

Machine Learning · Computer Science 2025-05-28 Qunzhong Wang , Xiangguo Sun , Hong Cheng

Transfer learning enhances prediction accuracy on a target distribution by leveraging data from a source distribution, demonstrating significant benefits in various applications. This paper introduces a novel dissimilarity measure that…

Machine Learning · Statistics 2024-12-12 Mitsuhiro Fujikawa , Yohei Akimoto , Jun Sakuma , Kazuto Fukuchi

Modern machine learning methods often require more data for training than a single expert can provide. Therefore, it has become a standard procedure to collect data from external sources, e.g. via crowdsourcing. Unfortunately, the quality…

Machine Learning · Computer Science 2019-05-20 Nikola Konstantinov , Christoph Lampert

Quantile regression is increasingly encountered in modern big data applications due to its robustness and flexibility. We consider the scenario of learning the conditional quantiles of a specific target population when the available data…

Statistics Theory · Mathematics 2024-02-27 Jun Jin , Jun Yan , Robert H. Aseltine , Kun Chen

Transfer learning can be applied in deep reinforcement learning to accelerate the training of a policy in a target task by transferring knowledge from a policy learned in a related source task. This is commonly achieved by copying…

Machine Learning · Computer Science 2023-06-22 Joseph Campbell , Yue Guo , Fiona Xie , Simon Stepputtis , Katia Sycara

This paper studies the problem of continual learning in an open-world scenario, referred to as Open-world Continual Learning (OwCL). OwCL is increasingly rising while it is highly challenging in two-fold: i) learning a sequence of tasks…

Machine Learning · Computer Science 2023-12-27 Yujie Li , Xin Yang , Hao Wang , Xiangkun Wang , Tianrui Li