English
Related papers

Related papers: Novel and flexible parameter estimation methods fo…

200 papers

Conic optimization plays a crucial role in many machine learning (ML) problems. However, practical algorithms for conic constrained ML problems with large datasets are often limited to specific use cases, as stochastic algorithms for…

Optimization and Control · Mathematics 2025-11-11 Chuan He , Zhanwang Deng

The posterior probability distribution for a set of model parameters encodes all that the data have to tell us in the context of a given model; it is the fundamental quantity for Bayesian parameter estimation. In order to infer the…

Instrumentation and Methods for Astrophysics · Physics 2015-06-16 Rupert Allison , Joanna Dunkley

We present a computational framework for estimating the uncertainty in the numerical solution of linearized infinite-dimensional statistical inverse problems. We adopt the Bayesian inference formulation: given observational data and their…

Numerical Analysis · Mathematics 2013-08-07 Tan Bui-Thanh , Omar Ghattas , James Martin , Georg Stadler

Quantifying spatial and/or temporal associations in multivariate geolocated data of different types is achievable via spatial random effects in a Bayesian hierarchical model, but severe computational bottlenecks arise when spatial…

Methodology · Statistics 2024-04-02 Michele Peruzzi , David B. Dunson

A framework is presented for fitting inverse problem models via variational Bayes approximations. This methodology guarantees flexibility to statistical model specification for a broad range of applications, good accuracy and reduced model…

Methodology · Statistics 2024-09-05 Luca Maestrini , Robert G. Aykroyd , Matt P. Wand

Intuitive human-machine interfaces may be developed using pattern classification to estimate executed human motions from electromyogram (EMG) signals generated during muscle contraction. The continual use of EMG-based interfaces gradually…

Signal Processing · Electrical Eng. & Systems 2023-10-03 Seitaro Yoneda , Akira Furui

We propose a general framework for obtaining probabilistic solutions to PDE-based inverse problems. Bayesian methods are attractive for uncertainty quantification but assume knowledge of the likelihood model or data generation process. This…

Methodology · Statistics 2023-09-28 Youngsoo Baek , Wilkins Aquino , Sayan Mukherjee

Identifying the parameters of a model and rating competitive models based on measured data has been among the most important but challenging topics in modern science and engineering, with great potential of application in structural system…

Computation · Statistics 2017-08-02 F. A. DiazDelaO , A. Garbuno-Inigo , S. K. Au , I. Yoshida

Recently, generative machine-learning models have gained popularity in physics, driven by the goal of improving the efficiency of Markov chain Monte Carlo techniques and of exploring their potential in capturing experimental data…

Statistical Mechanics · Physics 2021-09-03 Japneet Singh , Vipul Arora , Vinay Gupta , Mathias S. Scheurer

Almost all fields of science rely upon statistical inference to estimate unknown parameters in theoretical and computational models. While the performance of modern computer hardware continues to grow, the computational requirements for the…

Computation · Statistics 2022-10-25 David J. Warne , Ruth E. Baker , Matthew J. Simpson

Stochastic reduced models are an important tool in climate systems whose many spatial and temporal scales cannot be fully discretized or underlying physics may not be fully accounted for. One form of reduced model, the linear inverse model…

Methodology · Statistics 2020-04-29 Dallas Foster , Darin Comeau , Nathan M. Urban

In Bayesian inverse problems, it is common to consider several hyperparameters that define the prior and the noise model that must be estimated from the data. In particular, we are interested in linear inverse problems with additive…

Numerical Analysis · Mathematics 2024-12-05 Julianne Chung , Scot M. Miller , Malena Sabate Landman , Arvind K. Saibaba

This paper develops a new empirical Bayesian inference algorithm for solving a linear inverse problem given multiple measurement vectors (MMV) of under-sampled and noisy observable data. Specifically, by exploiting the joint sparsity across…

Numerical Analysis · Mathematics 2021-03-30 Jiahui Zhang , Anne Gelb , Theresa Scarnati

Parameter estimation remains a challenging task across many areas of engineering. Because data acquisition can often be costly, limited, or prone to inaccuracies (noise, uncertainty) it is crucial to identify sensor configurations that…

Machine Learning · Statistics 2025-11-20 Georgios Venianakis , Constantinos Theodoropoulos , Michail Kavousanakis

Out of the recent advances in systems and control (S\&C)-based analysis of optimization algorithms, not enough work has been specifically dedicated to machine learning (ML) algorithms and its applications. This paper addresses this gap by…

Machine Learning · Computer Science 2021-02-15 Orlando Romero , Subhro Das , Pin-Yu Chen , Sérgio Pequito

Inverse problems arise almost everywhere in science and engineering where we need to infer on a quantity from indirect observation. The cases of medical, biomedical, and industrial imaging systems are the typical examples. A very high…

Machine Learning · Computer Science 2025-02-20 Ali Mohammad-Djafari

Diffusion models (DMs) have proven to be effective in modeling high-dimensional distributions, leading to their widespread adoption for representing complex priors in Bayesian inverse problems (BIPs). However, current DM-based posterior…

Machine Learning · Computer Science 2025-06-06 Haoxuan Chen , Yinuo Ren , Martin Renqiang Min , Lexing Ying , Zachary Izzo

The sampling efficiency of MCMC methods in Bayesian inference for stochastic volatility (SV) models is known to highly depend on the actual parameter values, and the effectiveness of samplers based on different parameterizations varies…

Computation · Statistics 2019-12-02 Darjus Hosszejni , Gregor Kastner

Mathematical models are invaluable for understanding and predicting how biological systems behave, although their construction requires specifying mechanisms and relationships that are often not perfectly known. In the presence of multiple…

We consider the problem of estimating rare event probabilities, focusing on systems whose evolution is governed by differential equations with uncertain input parameters. If the system dynamics is expensive to compute, standard sampling…

Computation · Statistics 2019-11-05 Siddhant Wahal , George Biros