中文
相关论文

相关论文: Bayesian Transfer Learning for Enhanced Estimation…

200 篇论文

Inverse problems, i.e., estimating parameters of physical models from experimental data, are ubiquitous in science and engineering. The Bayesian formulation is the gold standard because it alleviates ill-posedness issues and quantifies…

机器学习 · 统计学 2024-05-28 Sharmila Karumuri , Ilias Bilionis

Transfer learning is a powerful tool enabling model training with limited amounts of data. This technique is particularly useful in real-world problems where data availability is often a serious limitation. The simplest transfer learning…

机器学习 · 计算机科学 2023-03-03 Federica Gerace , Diego Doimo , Stefano Sarao Mannelli , Luca Saglietti , Alessandro Laio

With the emergence of large-scale pre-trained neural networks, methods to adapt such "foundation" models to data-limited downstream tasks have become a necessity. Fine-tuning, preference optimization, and transfer learning have all been…

机器学习 · 统计学 2025-07-09 Javan Tahir , Surya Ganguli , Grant M. Rotskoff

We propose a new method for conducting Bayesian prediction that delivers accurate predictions without correctly specifying the unknown true data generating process. A prior is defined over a class of plausible predictive models. After…

统计方法学 · 统计学 2020-08-24 Ruben Loaiza-Maya , Gael M. Martin , David T. Frazier

In the context of a vector autoregression (VAR) model, or any multivariate regression model, the number of relevant predictors may be small relative to the information set available from which to build a prediction equation. It is well…

应用统计 · 统计学 2017-09-25 Lendie Follett , Cindy Yu

Statistical analysis of network data has attracted considerable attention in recent years, due to the rapid advancement of well-trained network models and the accessibility of large public network datasets. In this article, we propose a…

统计方法学 · 统计学 2026-04-22 Yong He , Kangxiang Qin , Haoran Tang

Bounded continuous responses -- such as proportions -- arise frequently in diverse scientific fields including climatology, biostatistics, and finance. Beta regression is a widely adopted framework for modeling such data, due to the…

统计方法学 · 统计学 2025-05-29 The Tien Mai

Residual networks, as discrete approximations of Ordinary Differential Equations (ODEs), have inspired significant advancements in neural network design, including multistep methods, high-order methods, and multi-particle dynamical systems.…

计算与语言 · 计算机科学 2024-11-06 Bei Li , Tong Zheng , Rui Wang , Jiahao Liu , Qingyan Guo , Junliang Guo , Xu Tan , Tong Xiao , Jingbo Zhu , Jingang Wang , Xunliang Cai

Transfer learning has recently shown significant performance across various tasks involving deep neural networks. In these transfer learning scenarios, the prior distribution for downstream data becomes crucial in Bayesian model averaging…

机器学习 · 计算机科学 2024-03-13 Hyungi Lee , Giung Nam , Edwin Fong , Juho Lee

What is the best way to exploit extra data -- be it unlabeled data from the same task, or labeled data from a related task -- to learn a given task? This paper formalizes the question using the theory of reference priors. Reference priors…

机器学习 · 统计学 2022-06-17 Yansong Gao , Rahul Ramesh , Pratik Chaudhari

Bayesian optimization is popular for optimizing time-consuming black-box objectives. Nonetheless, for hyperparameter tuning in deep neural networks, the time required to evaluate the validation error for even a few hyperparameter settings…

机器学习 · 计算机科学 2019-03-13 Jian Wu , Saul Toscano-Palmerin , Peter I. Frazier , Andrew Gordon Wilson

Given a supervised machine learning problem where the training set has been subject to a known sampling bias, how can a model be trained to fit the original dataset? We achieve this through the Bayesian inference framework by altering the…

机器学习 · 统计学 2022-03-16 Max Sklar

Benefiting from deep learning research and large-scale datasets, saliency prediction has achieved significant success in the past decade. However, it still remains challenging to predict saliency maps on images in new domains that lack…

计算机视觉与模式识别 · 计算机科学 2020-07-13 Yan Luo , Yongkang Wong , Mohan S. Kankanhalli , Qi Zhao

Deep learning for human sensing on edge systems presents significant potential for smart applications. However, its training and development are hindered by the limited availability of sensor data and resource constraints of edge systems.…

计算机视觉与模式识别 · 计算机科学 2026-05-28 Yu Zhang , Xi Zhang , Hualin Zhou , Xinyuan Chen , Shang Gao , Hong Jia , Jianfei Yang , Yuankai Qi , Tao Gu

Precision matrix estimation is essential in various fields; yet it is challenging when samples for the target study are limited. Transfer learning can enhance estimation accuracy by leveraging data from related source studies. We propose…

机器学习 · 统计学 2026-03-31 Boxin Zhao , Cong Ma , Mladen Kolar

Knowledge transfer between heterogeneous source and target networks and tasks has received a lot of attention in recent times as large amounts of quality labeled data can be difficult to obtain in many applications. Existing approaches…

In many large-scale inverse problems, such as computed tomography and image deblurring, characterization of sharp edges in the solution is desired. Within the Bayesian approach to inverse problems, edge-preservation is often achieved using…

统计计算 · 统计学 2022-07-20 Felipe Uribe , Yiqiu Dong , Per Christian Hansen

Bayesian models quantify uncertainty and facilitate optimal decision-making in downstream applications. For most models, however, practitioners are forced to use approximate inference techniques that lead to sub-optimal decisions due to…

机器学习 · 统计学 2019-09-12 Tomasz Kuśmierczyk , Joseph Sakaya , Arto Klami

Constraints are a natural choice for prior information in Bayesian inference. In various applications, the parameters of interest lie on the boundary of the constraint set. In this paper, we use a method that implicitly defines a…

统计理论 · 数学 2022-09-27 Jasper Marijn Everink , Yiqiu Dong , Martin Skovgaard Andersen

Posterior drift refers to changes in the relationship between responses and covariates while the distributions of the covariates remain unchanged. In this work, we explore functional linear regression under posterior drift with transfer…

统计方法学 · 统计学 2024-12-20 Xiaoyu Hu , Zhenhua Lin