English
Related papers

Related papers: A Novel Sparsity-Based Approach to Recursive Estim…

200 papers

Bayesian methods are actively used for parameter identification and uncertainty quantification when solving nonlinear inverse problems with random noise. However, there are only few theoretical results justifying the Bayesian approach.…

Statistics Theory · Mathematics 2020-02-04 Vladimir Spokoiny

Linear mixed models are a versatile statistical tool to study data by accounting for fixed effects and random effects from multiple sources of variability. In many situations, a large number of candidate fixed effects is available and it is…

Methodology · Statistics 2022-09-09 Emanuele Degani , Luca Maestrini , Dorota Toczydłowska , Matt P. Wand

In recent years, a rich variety of regularization procedures have been proposed for high dimensional regression problems. However, tuning parameter choice and computational efficiency in ultra-high dimensional problems remain vexing issues.…

Computation · Statistics 2012-01-18 Hua Zhou , Artin Armagan , David B. Dunson

Bayesian filtering is a general framework for recursively estimating the state of a dynamical system. Classical solutions such that Kalman filter and Particle filter are introduced in this report. Gaussian processes have been introduced as…

Information Theory · Computer Science 2010-11-04 Mr. Chong Han , Dr. Ido Nevat , Dr. Gareth Peters , Prof. Jinhong Yuan

Dynamical system state estimation and parameter calibration problems are ubiquitous across science and engineering. Bayesian approaches to the problem are the gold standard as they allow for the quantification of uncertainties and enable…

Data Analysis, Statistics and Probability · Physics 2024-11-12 Kairui Hao , Ilias Bilionis

This paper develops a novel Bayesian approach for nonlinear regression with symmetric matrix predictors, often used to encode connectivity of different nodes. Unlike methods that vectorize matrices as predictors that result in a large…

Methodology · Statistics 2024-07-22 Xiaomeng Ju , Hyung G. Park , Thaddeus Tarpey

The convergence of expectation-maximization (EM)-based algorithms typically requires continuity of the likelihood function with respect to all the unknown parameters (optimization variables). The requirement is not met when parameters…

Signal Processing · Electrical Eng. & Systems 2024-04-18 Geethu Joseph

Bayesian estimation is a powerful theoretical paradigm for the operation of quantum sensors. However, the Bayesian method for statistical inference generally suffers from demanding calibration requirements that have so far restricted its…

Quantum Physics · Physics 2021-09-22 Samuel P. Nolan , Augusto Smerzi , Luca Pezzè

This paper re-examines the problem of parameter estimation in Bayesian networks with missing values and hidden variables from the perspective of recent work in on-line learning [Kivinen & Warmuth, 1994]. We provide a unified framework for…

Machine Learning · Computer Science 2013-02-08 Eric Bauer , Daphne Koller , Yoram Singer

Graphical models describe associations between variables through the notion of conditional independence. Gaussian graphical models are a widely used class of such models where the relationships are formalized by non-null entries of the…

Methodology · Statistics 2023-08-08 Sagnik Bhadury , Riten Mitra , Jeremy T. Gaskins

We propose a new sampling-based approach for approximate inference in filtering problems. Instead of approximating conditional distributions with a finite set of states, as done in particle filters, our approach approximates the…

Machine Learning · Computer Science 2020-03-03 Xuan Su , Wee Sun Lee , Zhen Zhang

Bayesian models often involve a small set of hyperparameters determined by maximizing the marginal likelihood. Bayesian optimization is a popular iterative method where a Gaussian process posterior of the underlying function is sequentially…

Computation · Statistics 2022-08-18 Oskar Gustafsson , Mattias Villani , Pär Stockhammar

The sparse Beyesian learning (also referred to as Bayesian compressed sensing) algorithm is one of the most popular approaches for sparse signal recovery, and has demonstrated superior performance in a series of experiments. Nevertheless,…

Information Theory · Computer Science 2015-01-21 Fuwei Li , Jun Fang , Huiping Duan , Zhi Chen , Hongbin Li

In this paper, a methodology is investigated for signal recovery in the presence of non-Gaussian noise. In contrast with regularized minimization approaches often adopted in the literature, in our algorithm the regularization parameter is…

Optimization and Control · Mathematics 2017-01-23 Yosra Marnissi , Yuling Zheng , Emilie Chouzenoux , Jean-Christophe Pesquet

This paper studies the problem of parameter estimation in resonant, acoustic fluid-structure interaction problems over a wide frequency range. Problems with multiple resonances are known to be subjected to local minima, which represents a…

Computational Physics · Physics 2019-03-06 Peter Göransson , Jacques Cuenca , Timo Lähivaara

Using observation data to estimate unknown parameters in computational models is broadly important. This task is often challenging because solutions are non-unique due to the complexity of the model and limited observation data. However,…

Methodology · Statistics 2018-12-18 Jiacheng Wu , Jian-Xun Wang , Shawn C. Shadden

We study system design problems stated as parameterized stochastic programs with a chance-constraint set. We adopt a Bayesian approach that requires the computation of a posterior predictive integral which is usually intractable. In…

Machine Learning · Statistics 2020-01-07 Prateek Jaiswal , Harsha Honnappa , Vinayak A. Rao

We study a regularization framework that combines a convex fidelity term with multiple $\ell_1$-based regularizers, each linked to a distinct linear transform. This multi-penalty model enhances flexibility in promoting structured sparsity.…

Numerical Analysis · Mathematics 2026-02-02 Qianru Liu , Rui Wang , Yuesheng Xu

To infer the parameters of mechanistic models with intractable likelihoods, techniques such as approximate Bayesian computation (ABC) are increasingly being adopted. One of the main disadvantages of ABC in practical situations, however, is…

Computation · Statistics 2018-08-03 Jonathan U Harrison , Ruth E Baker

Bayesian analysis is a framework for parameter estimation that applies even in uncertainty regimes where the commonly used local (frequentist) analysis based on the Cram\'er-Rao bound is not well defined. In particular, it applies when no…

Quantum Physics · Physics 2021-03-17 Simon Morelli , Ayaka Usui , Elizabeth Agudelo , Nicolai Friis