English
Related papers

Related papers: Efficient grid-based Bayesian estimation of nonlin…

200 papers

A probability density function (pdf) encodes the entire stochastic knowledge about data distribution, where data may represent stochastic observations in robotics, transition state pairs in reinforcement learning or any other empirically…

Machine Learning · Computer Science 2018-09-18 Dmitry Kopitkov , Vadim Indelman

Density estimation plays a crucial role in many data analysis tasks, as it infers a continuous probability density function (PDF) from discrete samples. Thus, it is used in tasks as diverse as analyzing population data, spatial locations in…

Machine Learning · Computer Science 2021-07-26 Patrik Puchert , Pedro Hermosilla , Tobias Ritschel , Timo Ropinski

Estimating copulas with discrete marginal distributions is challenging, especially in high dimensions, because computing the likelihood contribution of each observation requires evaluating $2^{J}$ terms, with $J$ the number of discrete…

Methodology · Statistics 2018-11-12 D. Gunawan , M. -N. Tran , K. Suzuki , J. Dick , R. Kohn

In image reconstruction, an accurate quantification of uncertainty is of great importance for informed decision making. Here, the Bayesian approach to inverse problems can be used: the image is represented through a random function that…

Numerical Analysis · Mathematics 2025-04-24 Jonas Latz , Aretha L. Teckentrup , Simon Urbainczyk

Most simulation schemes for partial differential equations (PDEs) focus on minimizing a simple error norm of a discretized version of a field. This paper takes a fundamentally different approach; the discretized field is interpreted as data…

Methodology · Statistics 2018-04-18 Reimar H. Leike , Torsten A. Enßlin

Parton distribution functions (PDFs) form an essential part of particle physics calculations. Currently, the most precise predictions for these non-perturbative functions are generated through fits to global data. A problem that several PDF…

High Energy Physics - Phenomenology · Physics 2025-09-04 Mengshi Yan , Tie-Jiun Hou , Zhao Li , Kirtimaan Mohan , C. -P. Yuan

Gaussian process is a theoretically appealing model for nonparametric analysis, but its computational cumbersomeness hinders its use in large scale and the existing reduced-rank solutions are usually heuristic. In this work, we propose a…

Machine Learning · Statistics 2015-11-25 Leo L. Duan , Xia Wang , Rhonda D. Szczesniak

This paper aims to investigate the non-Markovian dynamics. The governing equations are derived for the probability density functions (PDFs) of non-Markovian stochastic responses to Langevin equation excited by combined fractional Gaussian…

Probability · Mathematics 2025-03-03 Bin Pei , Lifang Feng , Yunzhang Li , Yong Xu

In spite of the diverse literature on nonstationary spatial modeling and approximate Gaussian process (GP) methods, there are no general approaches for conducting fully Bayesian inference for moderately sized nonstationary spatial data sets…

Computation · Statistics 2020-07-01 Mark D. Risser , Daniel Turek

Computer experiments are becoming increasingly important in scientific investigations. In the presence of uncertainty, analysts employ probabilistic sensitivity methods to identify the key-drivers of change in the quantities of interest.…

Methodology · Statistics 2024-07-02 Isadora Antoniano-Villalobos , Emanuele Borgonovo , Xuefei Lu

Computer simulations of differential equations require a time discretization, which inhibits to identify the exact solution with certainty. Probabilistic simulations take this into account via uncertainty quantification. The construction of…

Numerical Analysis · Mathematics 2020-10-15 Philipp Frank , Torsten A. Enßlin

We evaluate the robustness of a probabilistic formulation of system identification (ID) to sparse, noisy, and indirect data. Specifically, we compare estimators of future system behavior derived from the Bayesian posterior of a learning…

Machine Learning · Statistics 2023-01-02 Nicholas Galioto , Alex Gorodetsky

In science and engineering, we often work with models designed for accurate prediction of variables of interest. Recognizing that these models are approximations of reality, it becomes desirable to apply multiple models to the same data and…

Machine Learning · Computer Science 2024-04-03 Marzieh Ajirak , Daniel Waxman , Fernando Llorente , Petar M. Djuric

This technical note considers the identification of nonlinear discrete-time systems with additive process noise but without measurement noise. In particular, we propose a method and its associated algorithm to identify the system nonlinear…

Optimization and Control · Mathematics 2015-04-27 Wei Pan , Ye Yuan , Jorge Gonçalves , Guy-Bart Stan

This article presents an up-to-date tutorial review of nonlinear Bayesian estimation. State estimation for nonlinear systems has been a challenge encountered in a wide range of engineering fields, attracting decades of research effort. To…

Systems and Control · Computer Science 2017-12-15 Huazhen Fang , Ning Tian , Yebin Wang , MengChu Zhou , Mulugeta A. Haile

State-space models have been successfully used for more than fifty years in different areas of science and engineering. We present a procedure for efficient variational Bayesian learning of nonlinear state-space models based on sparse…

Machine Learning · Computer Science 2014-11-04 Roger Frigola , Yutian Chen , Carl E. Rasmussen

We present two approximate Bayesian inference methods for parameter estimation in partial differential equation (PDE) models with space-dependent and state-dependent parameters. We demonstrate that these methods provide accurate and…

Methodology · Statistics 2019-09-04 David A. Barajas-Solano , Alexandre M. Tartakovsky

Bayesian models often involve a small set of hyperparameters determined by maximizing the marginal likelihood. Bayesian optimization is a popular iterative method where a Gaussian process posterior of the underlying function is sequentially…

Computation · Statistics 2022-08-18 Oskar Gustafsson , Mattias Villani , Pär Stockhammar

Most signal processing problems involve the challenging task of multidimensional probability density function (PDF) estimation. In this work, we propose a solution to this problem by using a family of Rotation-based Iterative…

Machine Learning · Statistics 2016-02-02 Valero Laparra , Gustavo Camps-Valls , Jesús Malo

Reliable density estimation is fundamental for numerous applications in statistics and machine learning. In many practical scenarios, data are best modeled as mixtures of component densities that capture complex and multimodal patterns.…

Machine Learning · Computer Science 2025-09-30 Mustafa Musab , Joseph K. Chege , Arie Yeredor , Martin Haardt