English
Related papers

Related papers: Probabilistic learning on manifolds constrained by…

200 papers

Identification of nonlinear dynamical systems is crucial across various fields, facilitating tasks such as control, prediction, optimization, and fault detection. Many applications require methods capable of handling complex systems while…

Machine Learning · Statistics 2024-11-05 Luc Brogat-Motte , Riccardo Bonalli , Alessandro Rudi

Compared to the wide array of advanced Monte Carlo methods supported by modern probabilistic programming languages (PPLs), PPL support for variational inference (VI) is less developed: users are typically limited to a predefined selection…

Programming Languages · Computer Science 2024-06-25 McCoy R. Becker , Alexander K. Lew , Xiaoyan Wang , Matin Ghavami , Mathieu Huot , Martin C. Rinard , Vikash K. Mansinghka

Physics-informed neural networks (PINNs) have received significant attention as a unified framework for forward, inverse, and surrogate modeling of problems governed by partial differential equations (PDEs). Training PINNs for forward…

Machine Learning · Computer Science 2022-06-22 Ehsan Haghighat , Danial Amini , Ruben Juanes

In this work, we propose a non-parametric probabilistic load flow (NP-PLF) technique based on the Gaussian Process (GP) learning to understand the power system behavior under uncertainty for better operational decisions. The technique can…

Systems and Control · Electrical Eng. & Systems 2020-03-19 Parikshit Pareek , Chuan Wang , Hung D. Nguyen

Designing models that are both expressive and preserve known invariances of tasks is an increasingly hard problem. Existing solutions tradeoff invariance for computational or memory resources. In this work, we show how to leverage…

Machine Learning · Computer Science 2023-09-29 Leonardo Cotta , Gal Yehuda , Assaf Schuster , Chris J. Maddison

Recently, researchers have utilized neural networks to accurately solve partial differential equations (PDEs), enabling the mesh-free method for scientific computation. Unfortunately, the network performance drops when encountering a high…

Machine Learning · Computer Science 2021-09-29 Pongpisit Thanasutives , Masayuki Numao , Ken-ichi Fukui

Partial Differential Equations (PDEs) are fundamental tools for modeling physical phenomena, yet most PDEs of practical interest cannot be solved analytically and require numerical approximations. The feasibility of such numerical methods,…

Numerical Analysis · Mathematics 2025-12-03 Juan Esteban Suarez Cardona , Holger Boche , Gitta Kutyniok

Partial differential equations (PDEs) that fit scientific data can represent physical laws with explainable mechanisms for various mathematically-oriented subjects, such as physics and finance. The data-driven discovery of PDEs from…

Machine Learning · Computer Science 2023-05-29 Yingtao Luo , Qiang Liu , Yuntian Chen , Wenbo Hu , Tian Tian , Jun Zhu

Random invariant manifolds are geometric objects useful for understanding complex dynamics under stochastic influences. Under a nonuniform hyperbolicity or a nonuniform exponential dichotomy condition, the existence of random pseudo-stable…

Dynamical Systems · Mathematics 2009-01-06 Tomas Caraballo , Jinqiao Duan , Kening Lu , Bjorn Schmalfuss

Traditional Monte Carlo integration using uniform random sampling exhibits degraded efficiency in low-regularity or high-dimensional problems. We propose a novel deep learning framework based on deterministic number-theoretic sampling…

Numerical Analysis · Mathematics 2025-07-03 Yu Yang , Pingan He , Xiaoling Peng , Qiaolin He

In this paper we establish a connection between non-convex optimization methods for training deep neural networks and nonlinear partial differential equations (PDEs). Relaxation techniques arising in statistical physics which have already…

Machine Learning · Computer Science 2017-06-05 Pratik Chaudhari , Adam Oberman , Stanley Osher , Stefano Soatto , Guillaume Carlier

Recently deep learning surrogates and neural operators have shown promise in solving partial differential equations (PDEs). However, they often require a large amount of training data and are limited to bounded domains. In this work, we…

Machine Learning · Computer Science 2023-08-25 Zhiwei Fang , Sifan Wang , Paris Perdikaris

We propose a new reduced order modeling strategy for tackling parametrized Partial Differential Equations (PDEs) with linear constraints, in particular Darcy flow systems in which the constraint is given by mass conservation. Our approach…

Numerical Analysis · Mathematics 2023-11-27 Wietse M. Boon , Nicola R. Franco , Alessio Fumagalli , Paolo Zunino

This paper studies constrained Markov decision processes (CMDPs) with constraints against stochastic thresholds, aiming at safety of reinforcement learning in unknown and uncertain environments. We leverage a Growing-Window estimator…

Machine Learning · Computer Science 2025-12-25 Qian Zuo , Fengxiang He

The long runtime of high-fidelity partial differential equation (PDE) solvers makes them unsuitable for time-critical applications. We propose to accelerate PDE solvers using reduced-order modeling (ROM). Whereas prior ROM approaches reduce…

This work is concerned with the quantification of the epistemic uncertainties induced the discretization of partial differential equations. Following the paradigm of probabilistic numerics, we quantify this uncertainty probabilistically.…

Probability · Mathematics 2016-07-14 Ilias Bilionis

We propose new limiting dynamics for stochastic gradient descent in the small learning rate regime called stochastic modified flows. These SDEs are driven by a cylindrical Brownian motion and improve the so-called stochastic modified…

Probability · Mathematics 2023-02-15 Benjamin Gess , Sebastian Kassing , Vitalii Konarovskyi

We study a probabilistic numerical method for the solution of both boundary and initial value problems that returns a joint Gaussian process posterior over the solution. Such methods have concrete value in the statistics on Riemannian…

Machine Learning · Statistics 2014-02-13 Philipp Hennig , Søren Hauberg

Preference learning in Large Language Models (LLMs) has advanced significantly, yet existing methods remain limited by modest performance gains, high computational costs, hyperparameter sensitivity, and insufficient modeling of global…

Computation and Language · Computer Science 2026-04-03 Liang Zhu , Yuelin Bai , Xiankun Ren , Jiaxi Yang , Lei Zhang , Feiteng Fang , Hamid Alinejad-Rokny , Minghuan Tan , Min Yang

High resolution simulations of incompressible flows have become routine across a range of engineering applications. Despite their routine use, due to the high dimensional parameter space present for most practical applications, a…

Fluid Dynamics · Physics 2022-11-14 Christopher J. McDevitt , Eric Fowler , Subrata Roy