English
Related papers

Related papers: Bayesian polynomial neural networks and polynomial…

200 papers

We develop variational Laplace for Bayesian neural networks (BNNs) which exploits a local approximation of the curvature of the likelihood to estimate the ELBO without the need for stochastic sampling of the neural-network weights. The…

Machine Learning · Statistics 2021-07-21 Ali Unlu , Laurence Aitchison

We develop variational Laplace for Bayesian neural networks (BNNs) which exploits a local approximation of the curvature of the likelihood to estimate the ELBO without the need for stochastic sampling of the neural-network weights. The…

Machine Learning · Statistics 2021-08-11 Ali Unlu , Laurence Aitchison

Symbolic regression is a type of discrete optimization problem that involves searching expressions that fit given data points. In many cases, other mathematical constraints about the unknown expression not only provide more information…

Machine Learning · Computer Science 2021-02-16 Li Li , Minjie Fan , Rishabh Singh , Patrick Riley

Ordinary differential equations (ODEs) are a mathematical model used in many application areas such as climatology, bioinformatics, and chemical engineering with its intuitive appeal to modeling. Despite ODE's wide usage in modeling, the…

Applications · Statistics 2021-08-10 Hyunjoo Yang , Jaeyong Lee

Bayesian inverse problems are often computationally challenging when the forward model is governed by complex partial differential equations (PDEs). This is typically caused by expensive forward model evaluations and high-dimensional…

Machine Learning · Statistics 2023-02-08 Zhihang Xu , Yingzhi Xia , Qifeng Liao

As models of cognition grow in complexity and number of parameters, Bayesian inference with standard methods can become intractable, especially when the data-generating model is of unknown analytic form. Recent advances in simulation-based…

Machine Learning · Statistics 2020-07-14 Stefan T. Radev , Andreas Voss , Eva Marie Wieschen , Paul-Christian Bürkner

Probabilistic ordinary differential equation (ODE) solvers have been introduced over the past decade as uncertainty-aware numerical integrators. They typically proceed by assuming a functional prior to the ODE solution, which is then…

Numerical Analysis · Mathematics 2025-03-25 Yvann Le Fay , Simo Särkkä , Adrien Corenflos

Bayesian approach, as a useful tool for quantifying uncertainties, has been widely used for solving inverse problems of partial differential equations (PDEs). One of the key difficulties for employing Bayesian approach for the issue is how…

Numerical Analysis · Mathematics 2026-02-09 Junxiong Jia , Qian Zhao , Zongben Xu , Deyu Meng , Yee Leung

Datasets in engineering applications are often limited and contaminated, mainly due to unavoidable measurement noise and signal distortion. Thus, using conventional data-driven approaches to build a reliable discriminative model, and…

Machine Learning · Statistics 2020-04-14 Xihaier Luo , Ahsan Kareem

The numerical solution of high dimensional partial differential equations (PDEs) is severely constrained by the curse of dimensionality (CoD), rendering classical grid--based methods impractical beyond a few dimensions. In recent years,…

Numerical Analysis · Mathematics 2026-01-27 Wenzhong Zhang , Zheyuan Hu , Wei Cai , George EM Karniadakis

The performance of error correction in the surface code can be enhanced by leveraging the knowledge of the noise model for physical qubits. To provide accurate noise information to the decoder in parallel with quantum computation, an…

Quantum Physics · Physics 2025-12-04 Takumi Kobori , Synge Todo

The numerical solution of differential equations can be formulated as an inference problem to which formal statistical approaches can be applied. However, nonlinear partial differential equations (PDEs) pose substantial challenges from an…

Numerical Analysis · Mathematics 2021-08-26 Junyang Wang , Jon Cockayne , Oksana Chkrebtii , T. J. Sullivan , Chris. J. Oates

Bayesian neural network models (BNN) have re-surged in recent years due to the advancement of scalable computations and its utility in solving complex prediction problems in a wide variety of applications. Despite the popularity and…

Machine Learning · Statistics 2020-11-20 Shrijita Bhattacharya , Zihuan Liu , Tapabrata Maiti

This paper studies a new and highly efficient Markov chain Monte Carlo (MCMC) methodology to perform Bayesian inference in low-photon imaging problems, with particular attention to situations involving observation noise processes that…

Bayesian neural networks (BNNs) have been long considered an ideal, yet unscalable solution for improving the robustness and the predictive uncertainty of deep neural networks. While they could capture more accurately the posterior…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Gianni Franchi , Andrei Bursuc , Emanuel Aldea , Severine Dubuisson , Isabelle Bloch

Machine learning methods for computational imaging require uncertainty estimation to be reliable in real settings. While Bayesian models offer a computationally tractable way of recovering uncertainty, they need large data volumes to be…

Machine Learning · Computer Science 2020-08-24 Francesco Tonolini , Jack Radford , Alex Turpin , Daniele Faccio , Roderick Murray-Smith

This paper studies stochastic optimization problems with polynomials. We propose an optimization model with sample averages and perturbations. The Lasserre type Moment-SOS relaxations are used to solve the sample average optimization.…

Optimization and Control · Mathematics 2019-08-19 Jiawang Nie , Liu Yang , Suhan Zhong

We propose a novel approach to perform approximate Bayesian inference in complex models such as Bayesian neural networks. The approach is more scalable to large data than Markov Chain Monte Carlo, it embraces more expressive models than…

Machine Learning · Statistics 2022-09-07 Joel Janek Dabrowski , Daniel Edward Pagendam

Data point selection (DPS) is becoming a critical topic in deep learning due to the ease of acquiring uncurated training data compared to the difficulty of obtaining curated or processed data. Existing approaches to DPS are predominantly…

Machine Learning · Computer Science 2024-11-07 Xinnuo Xu , Minyoung Kim , Royson Lee , Brais Martinez , Timothy Hospedales

Bayesian Neural Networks (BNNs) provide a tool to estimate the uncertainty of a neural network by considering a distribution over weights and sampling different models for each input. In this paper, we propose a method for uncertainty…

Machine Learning · Computer Science 2024-10-28 Illia Oleksiienko , Dat Thanh Tran , Alexandros Iosifidis