English
Related papers

Related papers: Bayesian Consistency for Long Memory Processes: A …

200 papers

The paper discusses the reconstruction of potentials for quantum systems at finite temperatures from observational data. A nonparametric approach is developed, based on the framework of Bayesian statistics, to solve such inverse problems.…

Quantum Physics · Physics 2009-11-06 J. C. Lemm , J. Uhlig , A. Weiguny

Sequential Bayesian inference can be used for continual learning to prevent catastrophic forgetting of past tasks and provide an informative prior when learning new tasks. We revisit sequential Bayesian inference and test whether having…

Machine Learning · Computer Science 2025-01-09 Samuel Kessler , Adam Cobb , Tim G. J. Rudner , Stefan Zohren , Stephen J. Roberts

We look into the nonparametric regression estimation with additive and multiplicative noise and construct adaptive thresholding estimators based on Laguerre series. The proposed approach achieves asymptotically near-optimal convergence…

Statistics Theory · Mathematics 2020-12-23 Rida Benhaddou

This paper studies the error metric selection for long-term memory learning in sequence modelling. We examine the bias towards short-term memory in commonly used errors, including mean absolute/squared error. Our findings show that all…

Machine Learning · Computer Science 2023-07-24 Shida Wang , Zhanglu Yan

Inverse problems can be described as limited-data problems in which the signal of interest cannot be observed directly. A physics-based forward model that relates the signal with the observations is typically needed. Unfortunately, unknown…

Signal Processing · Electrical Eng. & Systems 2025-07-08 Alexandra Koulouri , Ville Rimpilainen

Generalized linear models (GLMs) are routinely used for modeling relationships between a response variable and a set of covariates. The simple form of a GLM comes with easy interpretability, but also leads to concerns about model…

Methodology · Statistics 2023-11-10 Davide Agnoletto , Tommaso Rigon , David B. Dunson

We present a simulation methodology for Bayesian estimation of rate parameters in Markov jump processes arising for example in stochastic kinetic models. To handle the problem of missing components and measurement errors in observed data,…

Computation · Statistics 2010-09-01 Michael Amrein , Hans R. Kuensch

Bayesian Optimization (BO) is a common approach for hyperparameter optimization (HPO) in automated machine learning. Although it is well-accepted that HPO is crucial to obtain well-performing machine learning models, tuning BO's own…

Machine Learning · Computer Science 2019-08-20 Marius Lindauer , Matthias Feurer , Katharina Eggensperger , André Biedenkapp , Frank Hutter

Distribution regression has recently attracted much interest as a generic solution to the problem of supervised learning where labels are available at the group level, rather than at the individual level. Current approaches, however, do not…

Machine Learning · Statistics 2021-01-18 Ho Chung Leon Law , Danica J. Sutherland , Dino Sejdinovic , Seth Flaxman

Bayesian Neural Networks provide a principled framework for uncertainty quantification by modeling the posterior distribution of network parameters. However, exact posterior inference is computationally intractable, and widely used…

Machine Learning · Computer Science 2025-12-02 Alfredo Reichlin , Miguel Vasco , Danica Kragic

Bayesian models quantify uncertainty and facilitate optimal decision-making in downstream applications. For most models, however, practitioners are forced to use approximate inference techniques that lead to sub-optimal decisions due to…

Machine Learning · Statistics 2019-09-12 Tomasz Kuśmierczyk , Joseph Sakaya , Arto Klami

Gaussian process regression is a well-established Bayesian machine learning method. We propose a new approach to Gaussian process regression using quantum kernels based on parameterized quantum circuits. By employing a hardware-efficient…

Quantum Physics · Physics 2024-02-06 Frederic Rapp , Marco Roth

Spectral singularities at non-zero frequencies play an important role in investigating cyclic or seasonal time series. The publication [2] introduced the generalized filtered method-of-moments approach to simultaneously estimate singularity…

Statistics Theory · Mathematics 2020-11-13 Antoine Ayache , Myriam Fradon , Ravindi Nanayakkara , Andriy Olenko

Almost all fields of science rely upon statistical inference to estimate unknown parameters in theoretical and computational models. While the performance of modern computer hardware continues to grow, the computational requirements for the…

Computation · Statistics 2022-10-25 David J. Warne , Ruth E. Baker , Matthew J. Simpson

In Bayesian statistics, one's prior beliefs about underlying model parameters are revised with the information content of observed data from which, using Bayes' rule, a posterior belief is obtained. A non-trivial example taken from the…

High Energy Physics - Phenomenology · Physics 2007-05-23 J. Charles , A. Hocker , H. Lacker , F. R. Le Diberder , S. T'Jampens

Online learning via Bayes' theorem allows new data to be continuously integrated into an agent's current beliefs. However, a naive application of Bayesian methods in non stationary environments leads to slow adaptation and results in state…

Machine Learning · Computer Science 2022-02-09 Josue Nassar , Jennifer Brennan , Ben Evans , Kendall Lowrey

Deep learning models, such as convolutional neural networks, have long been applied to image and multi-media tasks, particularly those with structured data. More recently, there has been more attention to unstructured data that can be…

Machine Learning · Computer Science 2021-09-17 Rohitash Chandra , Ayush Bhagat , Manavendra Maharana , Pavel N. Krivitsky

It is commonly assumed that a specific testing occasion (task, design, procedure, etc.) provides insights that generalise beyond that occasion. This assumption is infrequently carefully tested in data. We develop a statistically principled…

Applications · Statistics 2020-03-27 Laura Wall , David Gunawan , Scott D. Brown , Minh-Ngoc Tran , Robert Kohn , Guy E. Hawkins

Bayesian methods are increasingly being applied to parameterize mechanistic process models used in environmental prediction and forecasting. In particular, models describing ecosystem dynamics with multiple states that are linear and…

Applications · Statistics 2021-10-19 John W. Smith , Leah R. Johnson , Robert Q. Thomas

The estimation of unknown values of parameters (or hidden variables, control variables) that characterise a physical system often relies on the comparison of measured data with synthetic data produced by some numerical simulator of the…

Machine Learning · Computer Science 2019-01-28 Xi Chen , Mike Hobson