English
Related papers

Related papers: Learning Functional Priors and Posteriors from Dat…

200 papers

Deep learning is increasingly moving towards a transfer learning paradigm whereby large foundation models are fine-tuned on downstream tasks, starting from an initialization learned on the source task. But an initialization contains…

Machine Learning · Computer Science 2022-05-23 Ravid Shwartz-Ziv , Micah Goldblum , Hossein Souri , Sanyam Kapoor , Chen Zhu , Yann LeCun , Andrew Gordon Wilson

In this paper, we introduce an innovative approach for addressing Bayesian inverse problems through the utilization of physics-informed invertible neural networks (PI-INN). The PI-INN framework encompasses two sub-networks: an invertible…

Numerical Analysis · Mathematics 2023-10-04 Xiaofei Guan , Xintong Wang , Hao Wu , Zihao Yang , Peng Yu

Inverse problems arise across scientific and engineering domains, where the goal is to infer hidden parameters or physical fields from indirect and noisy observations. Classical approaches, such as variational regularization and Bayesian…

Machine Learning · Statistics 2025-12-03 Ali Mohammad-Djafari , Ning Chu , Li Wang

Inverse problems are ubiquitous in nature, arising in almost all areas of science and engineering ranging from geophysics and climate science to astrophysics and biomechanics. One of the central challenges in solving inverse problems is…

Machine Learning · Statistics 2022-09-21 Dhruv V Patel , Deep Ray , Assad A Oberai

Inverse problems arise almost everywhere in science and engineering where we need to infer on a quantity from indirect observation. The cases of medical, biomedical, and industrial imaging systems are the typical examples. A very high…

Machine Learning · Computer Science 2025-02-20 Ali Mohammad-Djafari

A deep generative model that describes human motions can benefit a wide range of fundamental computer vision and graphics tasks, such as providing robustness to video-based human pose estimation, predicting complete body movements for…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Jiaman Li , Ruben Villegas , Duygu Ceylan , Jimei Yang , Zhengfei Kuang , Hao Li , Yajie Zhao

This paper presents a structure-preserving Bayesian approach for learning nonseparable Hamiltonian systems using stochastic dynamic models allowing for statistically-dependent, vector-valued additive and multiplicative measurement noise.…

Machine Learning · Statistics 2024-07-23 Nicholas Galioto , Harsh Sharma , Boris Kramer , Alex Arkady Gorodetsky

Classical sequential models employed in time-series prediction rely on learning the mappings from the past to the future instances by way of a hidden state. The Hidden states characterise the historical information and encode the required…

Machine Learning · Computer Science 2023-02-14 Vignesh Gopakumar , Stanislas Pamela , Lorenzo Zanisi

For more than two centuries, solutions of differential equations have been obtained either analytically or numerically based on typically well-behaved forcing and boundary conditions for well-posed problems. We are changing this paradigm in…

Machine Learning · Computer Science 2017-03-08 Maziar Raissi , Paris Perdikaris , George Em. Karniadakis

Artificial intelligence (AI) for fluid mechanics has become attractive topic. High-fidelity data is one of most critical issues for the successful applications of AI in fluid mechanics, however, it is expensively obtained or even…

Machine Learning · Computer Science 2025-09-03 Ruilin Chen

The recent literature on deep learning offers new tools to learn a rich probability distribution over high dimensional data such as images or sounds. In this work we investigate the possibility of learning the prior distribution over neural…

Machine Learning · Statistics 2017-12-19 Alexandre Lacoste , Thomas Boquet , Negar Rostamzadeh , Boris Oreshkin , Wonchang Chung , David Krueger

We propose a method for learning dynamical systems from high-dimensional empirical data that combines variational autoencoders and (spatio-)temporal attention within a framework designed to enforce certain scientifically-motivated…

Machine Learning · Computer Science 2023-06-22 Kai Lagemann , Christian Lagemann , Sach Mukherjee

In image reconstruction, an accurate quantification of uncertainty is of great importance for informed decision making. Here, the Bayesian approach to inverse problems can be used: the image is represented through a random function that…

Numerical Analysis · Mathematics 2025-04-24 Jonas Latz , Aretha L. Teckentrup , Simon Urbainczyk

Prior-Data Fitted Networks (PFNs) enable amortized Bayesian inference in a single forward pass, yet their internal representations remain opaque. It is unknown whether PFNs encode identifiable Bayesian structure or merely memorize…

Machine Learning · Computer Science 2026-05-14 Kaustubh Sharma , Srijan Tiwari , Ojasva Nema , Parikshit Pareek

Physics-informed neural networks (PINNs) have emerged as a powerful paradigm for solving partial differential equations (PDEs) by embedding physical laws directly into neural network training. However, solving high-fidelity PDEs remains…

Machine Learning · Computer Science 2026-02-03 Olaf Yunus Laitinen Imanov

Meta-learning aims to extract useful inductive biases from a set of related datasets. In Bayesian meta-learning, this is typically achieved by constructing a prior distribution over neural network parameters. However, specifying families of…

Machine Learning · Computer Science 2023-06-13 Krunoslav Lehman Pavasovic , Jonas Rothfuss , Andreas Krause

Recent work in scientific machine learning has developed so-called physics-informed neural network (PINN) models. The typical approach is to incorporate physical domain knowledge as soft constraints on an empirical loss function and use…

Machine Learning · Computer Science 2021-11-12 Aditi S. Krishnapriyan , Amir Gholami , Shandian Zhe , Robert M. Kirby , Michael W. Mahoney

In recent years, neural networks (NNs) have become increasingly popular for surrogate modeling tasks in mechanics and materials modeling applications. While traditional NNs are deterministic functions that rely solely on data to learn the…

Machine Learning · Statistics 2025-01-03 Javad Ghorbanian , Nicholas Casaprima , Audrey Olivier

Hamiltonian neural networks (HNNs) represent a promising class of physics-informed deep learning methods that utilize Hamiltonian theory as foundational knowledge within neural networks. However, their direct application to engineering…

Machine Learning · Computer Science 2025-02-21 Sarvin Moradi , Gerben I. Beintema , Nick Jaensson , Roland Tóth , Maarten Schoukens

We investigate methods for learning partial differential equation (PDE) models from spatiotemporal data under biologically realistic levels and forms of noise. Recent progress in learning PDEs from data have used sparse regression to select…

Dynamical Systems · Mathematics 2021-04-28 John Lagergren , John T. Nardini , G. Michael Lavigne , Erica M. Rutter , Kevin B. Flores