English
Related papers

Related papers: Posterior-First Neural PDE Simulation: Inferring H…

200 papers

Calibration of neural networks is a topical problem that is becoming more and more important as neural networks increasingly underpin real-world applications. The problem is especially noticeable when using modern neural networks, for which…

Machine Learning · Computer Science 2023-08-29 Ondrej Bohdal , Yongxin Yang , Timothy Hospedales

This work identifies the existence and cause of a type of posterior collapse that frequently occurs in the Bayesian deep learning practice. For a general linear latent variable model that includes linear variational autoencoders as a…

Machine Learning · Computer Science 2022-10-17 Zihao Wang , Liu Ziyin

Monocular Depth Estimation (MDE) is a fundamental problem in computer vision with numerous applications. Recently, LIDAR-supervised methods have achieved remarkable per-pixel depth accuracy in outdoor scenes. However, significant errors are…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Lior Talker , Aviad Cohen , Erez Yosef , Alexandra Dana , Michael Dinerstein

The joint prediction of continuous fields and statistical estimation of the underlying discrete parameters is a common problem for many physical systems, governed by PDEs. Hitherto, it has been separately addressed by employing operator…

Machine Learning · Computer Science 2024-11-06 Levi E. Lingsch , Dana Grund , Siddhartha Mishra , Georgios Kissas

Prediction error quantification in machine learning has been left out of most methodological investigations of neural networks, for both purely data-driven and physics-informed approaches. Beyond statistical investigations and generic…

Machine Learning · Computer Science 2024-06-19 Birgit Hillebrecht , Benjamin Unger

We present a deep learning system to infer the posterior distribution of a dense depth map associated with an image, by exploiting sparse range measurements, for instance from a lidar. While the lidar may provide a depth value for a small…

Computer Vision and Pattern Recognition · Computer Science 2019-04-18 Yanchao Yang , Alex Wong , Stefano Soatto

Deep neural networks are a very powerful tool for many computer vision tasks, including image restoration, exhibiting state-of-the-art results. However, the performance of deep learning methods tends to drop once the observation model used…

Image and Video Processing · Electrical Eng. & Systems 2020-07-01 Jenny Zukerman , Tom Tirer , Raja Giryes

We develop a new Bayesian framework based on deep neural networks to be able to extrapolate in space-time using historical data and to quantify uncertainties arising from both noisy and gappy data in physical problems. Specifically, the…

Machine Learning · Computer Science 2022-03-14 Xuhui Meng , Liu Yang , Zhiping Mao , Jose del Aguila Ferrandis , George Em Karniadakis

Despite the numerous advances, reinforcement learning remains away from widespread acceptance for autonomous controller design as compared to classical methods due to lack of ability to effectively tackle the reality gap. The reliance on…

Machine Learning · Computer Science 2024-09-23 Narendra Patwardhan , Zequn Wang

Neural networks are being extensively used for modelling data, especially in the case where no likelihood can be formulated. Although in the case of X-ray spectral fitting, the likelihood is known, we aim to investigate the neural networks…

Instrumentation and Methods for Astrophysics · Physics 2024-02-22 Didier Barret , Simon Dupourqué

Inspired by the performance and scalability of autoregressive large language models (LLMs), transformer-based models have seen recent success in the visual domain. This study investigates a transformer adaptation for video prediction with a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Dean L Slack , G Thomas Hudson , Thomas Winterbottom , Noura Al Moubayed

Large language models exhibit impressive reasoning capabilities yet frequently generate plausible but incorrect solutions, a phenomenon commonly termed hallucination. This paper investigates the effect of training objective composition on…

Machine Learning · Computer Science 2026-01-13 Murtaza Nikzad , Raghuram Ramanujan

Neural posterior estimation (NPE) and neural likelihood estimation (NLE) are machine learning approaches that provide accurate posterior, and likelihood, approximations in complex modeling scenarios, and in situations where conducting…

Machine Learning · Statistics 2024-11-20 David T. Frazier , Ryan Kelly , Christopher Drovandi , David J. Warne

Federated Bayesian neural networks require fixing a prior on the model parameters together with a likelihood. Eliciting meaningful priors on the weight space of modern overparameterized models is notoriously difficult, and misspecification…

Machine Learning · Computer Science 2026-05-19 Boning Zhang , Matteo Zecchin , Mingzhao Guo , Dongzhu Liu , Osvaldo Simeone

Conservative inference is a major concern in simulation-based inference. It has been shown that commonly used algorithms can produce overconfident posterior approximations. Balancing has empirically proven to be an effective way to mitigate…

Machine Learning · Statistics 2023-04-24 Arnaud Delaunoy , Benjamin Kurt Miller , Patrick Forré , Christoph Weniger , Gilles Louppe

Recent studies in reinforcement learning (RL) have made significant progress by leveraging function approximation to alleviate the sample complexity hurdle for better performance. Despite the success, existing provably efficient algorithms…

Machine Learning · Computer Science 2023-11-07 Nikki Lijing Kuang , Ming Yin , Mengdi Wang , Yu-Xiang Wang , Yi-An Ma

We investigate the data-driven discovery of constitutive closures in nonlinear reaction-diffusion systems with known governing PDE structures. Our objective is to robustly recover diffusion and reaction laws from spatiotemporal observations…

Computational Engineering, Finance, and Science · Computer Science 2026-04-03 Hanbing Liang , Ze Tao , Fujun Liu

Recent advances in deep neural networks (DNNs) owe their success to training algorithms that use backpropagation and gradient-descent. Backpropagation, while highly effective on von Neumann architectures, becomes inefficient when scaling to…

Neural and Evolutionary Computing · Computer Science 2019-05-10 Brian Crafton , Abhinav Parihar , Evan Gebhardt , Arijit Raychowdhury

Neural networks have shown significant potential in solving partial differential equations (PDEs). While deep networks are capable of approximating complex functions, direct one-shot training often faces limitations in both accuracy and…

Numerical Analysis · Mathematics 2025-03-10 Mingxing Weng , Zhiping Mao , Jie Shen

Classic Bayesian methods with complex models are frequently infeasible due to an intractable likelihood. Simulation-based inference methods, such as Approximate Bayesian Computing (ABC), calculate posteriors without accessing a likelihood…

Computation · Statistics 2026-01-09 Elliot Maceda , Emily C. Hector , Amanda Lenzi , Brian J. Reich