English
Related papers

Related papers: Probabilistic Solutions to Differential Equations …

200 papers

By restricting the iterate on a nonlinear manifold, the recently proposed Riemannian optimization methods prove to be both efficient and effective in low rank tensor completion problems. However, existing methods fail to exploit the easily…

Machine Learning · Statistics 2017-02-24 Tengfei Zhou , Hui Qian , Zebang Shen , Congfu Xu

Numerical homogenization, i.e. the finite-dimensional approximation of solution spaces of PDEs with arbitrary rough coefficients, requires the identification of accurate basis elements. These basis elements are oftentimes found after a…

Numerical Analysis · Mathematics 2015-05-12 Houman Owhadi

This paper proposes a new method for solving Bayesian decision problems. The method consists of representing a Bayesian decision problem as a valuation-based system and applying a fusion algorithm for solving it. The fusion algorithm is a…

Artificial Intelligence · Computer Science 2013-03-26 Prakash P. Shenoy

For more than two centuries, solutions of differential equations have been obtained either analytically or numerically based on typically well-behaved forcing and boundary conditions for well-posed problems. We are changing this paradigm in…

Machine Learning · Computer Science 2017-03-08 Maziar Raissi , Paris Perdikaris , George Em. Karniadakis

We propose practical deep Gaussian process models on Riemannian manifolds, similar in spirit to residual neural networks. With manifold-to-manifold hidden layers and an arbitrary last layer, they can model manifold- and scalar-valued…

Machine Learning · Statistics 2025-03-03 Kacper Wyrwal , Andreas Krause , Viacheslav Borovitskiy

Optimization with orthogonality constraints frequently arises in various fields such as machine learning. Riemannian optimization offers a powerful framework for solving these problems by equipping the constraint set with a Riemannian…

Optimization and Control · Mathematics 2025-05-20 Andi Han , Pierre-Louis Poirion , Akiko Takeda

Quantum algorithms and complexity have recently been studied not only for discrete, but also for some numerical problems. Most attention has been paid so far to the integration problem, for which a speed-up is shown by quantum computers…

Quantum Physics · Physics 2007-05-23 Boleslaw Kacewicz

Several recent works have developed a new, probabilistic interpretation for numerical algorithms solving linear systems in which the solution is inferred in a Bayesian framework, either directly or by inferring the unknown action of the…

Computation · Statistics 2018-10-18 Simon Bartels , Jon Cockayne , Ilse C. F. Ipsen , Philipp Hennig

We consider maximum likelihood estimation for Gaussian Mixture Models (Gmms). This task is almost invariably solved (in theory and practice) via the Expectation Maximization (EM) algorithm. EM owes its success to various factors, of which…

Machine Learning · Statistics 2018-06-04 Reshad Hosseini , Suvrit Sra

It is well understood that Bayesian decision theory and average case analysis are essentially identical. However, if one is interested in performing uncertainty quantification for a numerical task, it can be argued that standard approaches…

Methodology · Statistics 2020-07-16 Chris. J. Oates , Jon Cockayne , Dennis Prangle , T. J. Sullivan , Mark Girolami

In engineering, accurately modeling nonlinear dynamic systems from data contaminated by noise is both essential and complex. Established Sequential Monte Carlo (SMC) methods, used for the Bayesian identification of these systems, facilitate…

Machine Learning · Statistics 2024-04-25 Joe D. Longbottom , Max D. Champneys , Timothy J. Rogers

Optimization under the symplecticity constraint is an approach for solving various problems in quantum physics and scientific computing. Building on the results that this optimization problem can be transformed into an unconstrained problem…

Optimization and Control · Mathematics 2024-06-21 Bin Gao , Nguyen Thanh Son , Tatjana Stykel

This paper is concerned with the study of constrained statistical learning problems, the unconstrained version of which are at the core of virtually all of modern information processing. Accounting for constraints, however, is paramount to…

Machine Learning · Computer Science 2020-02-14 Luiz F. O. Chamon , Santiago Paternain , Miguel Calvo-Fullana , Alejandro Ribeiro

In this paper we investigate the Bayesian approach to inverse Robin problems. These are problems for certain elliptic boundary value problems of determining a Robin coefficient on a hidden part of the boundary from Cauchy data on the…

Statistics Theory · Mathematics 2023-11-30 Aksel Kaastrup Rasmussen , Fanny Seizilles , Mark Girolami , Ieva Kazlauskaite

In recent years, manifold learning has become increasingly popular as a tool for performing non-linear dimensionality reduction. This has led to the development of numerous algorithms of varying degrees of complexity that aim to recover man…

Machine Learning · Statistics 2013-06-03 Dominique Perraul-Joncas , Marina Meila

We consider optimization problems on manifolds with equality and inequality constraints. A large body of work treats constrained optimization in Euclidean spaces. In this work, we consider extensions of existing algorithms from the…

Optimization and Control · Mathematics 2019-04-26 Changshuo Liu , Nicolas Boumal

The aim of this paper is to find the numerical solutions of the second order linear and nonlinear differential equations with Dirichlet, Neumann and Robin boundary conditions. We use the Bernoulli polynomials as linear combination to the…

Numerical Analysis · Computer Science 2023-05-31 Md. Shafiqul Islam , Afroza Shirin

We propose a probabilistic definition of solutions of semilinear elliptic equations with (possibly nonlocal) operators associated with regular Dirichlet forms and with measure data. Using the theory of backward stochastic differential…

Analysis of PDEs · Mathematics 2013-06-25 Tomasz Klimsiak , Andrzej Rozkosz

Linear partial differential equations (PDEs) are an important, widely applied class of mechanistic models, describing physical processes such as heat transfer, electromagnetism, and wave propagation. In practice, specialized numerical…

Machine Learning · Computer Science 2024-04-30 Marvin Pförtner , Ingo Steinwart , Philipp Hennig , Jonathan Wenger

We investigate the geometrical structure of probabilistic generative dimensionality reduction models using the tools of Riemannian geometry. We explicitly define a distribution over the natural metric given by the models. We provide the…

Machine Learning · Statistics 2014-12-01 Alessandra Tosi , Søren Hauberg , Alfredo Vellido , Neil D. Lawrence