English
Related papers

Related papers: Posterior-First Neural PDE Simulation: Inferring H…

200 papers

Embedding physical knowledge into neural network (NN) training has been a hot topic. However, when facing the complex real-world, most of the existing methods still strongly rely on the quantity and quality of observation data. Furthermore,…

Fluid Dynamics · Physics 2024-11-20 Dashan Zhang , Yuntian Chen , Shiyi Chen

Two major bottlenecks to the solution of large-scale Bayesian inverse problems are the scaling of posterior sampling algorithms to high-dimensional parameter spaces and the computational cost of forward model evaluations. Yet incomplete or…

Computation · Statistics 2016-05-03 Tiangang Cui , Youssef M. Marzouk , Karen E. Willcox

Time-dependent data-generating distributions have proven to be difficult for gradient-based training of neural networks, as the greedy updates result in catastrophic forgetting of previously learned knowledge. Despite the progress in the…

Machine Learning · Computer Science 2023-04-03 Matthias De Lange , Gido van de Ven , Tinne Tuytelaars

We propose a neural head reenactment system, which is driven by a latent pose representation and is capable of predicting the foreground segmentation alongside the RGB image. The latent pose representation is learned as a part of the entire…

Computer Vision and Pattern Recognition · Computer Science 2020-11-02 Egor Burkov , Igor Pasechnik , Artur Grigorev , Victor Lempitsky

Variational autoencoders model high-dimensional data by positing low-dimensional latent variables that are mapped through a flexible distribution parametrized by a neural network. Unfortunately, variational autoencoders often suffer from…

Machine Learning · Statistics 2023-01-03 Yixin Wang , David M. Blei , John P. Cunningham

In this work, we present the first stability results for approximate predictors in multi-input non-linear systems with distinct actuation delays. We show that if the predictor approximation satisfies a uniform (in time) error bound,…

Systems and Control · Electrical Eng. & Systems 2025-09-23 Filip Bajraktari , Luke Bhan , Miroslav Krstic , Yuanyuan Shi

Neural networks are one tool for approximating non-linear differential equations used in scientific computing tasks such as surrogate modeling, real-time predictions, and optimal control. PDE foundation models utilize neural networks to…

Machine Learning · Computer Science 2025-02-11 Elisa Negrini , Yuxuan Liu , Liu Yang , Stanley J. Osher , Hayden Schaeffer

Neural implicit modeling permits to achieve impressive 3D reconstruction results on small objects, while it exhibits significant limitations in large indoor scenes. In this work, we propose a novel neural implicit modeling method that…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Federico Lincetto , Gianluca Agresti , Mattia Rossi , Pietro Zanuttigh

Prompt-Tuning is an efficient method for adapting pre-trained language models to new tasks with minimal computational overhead by modifying prompt embeddings. In this work, we investigate how crucial the phenomenon of embedding collapse,…

Computation and Language · Computer Science 2026-03-10 Sergey Sedov , Sumanth Bharadwaj Hachalli Karanam , Venu Gopal Kadamba

Conditional Diffusion Models are powerful surrogates for emulating complex spatiotemporal dynamics, yet they often fail to match the accuracy of deterministic neural emulators for high-precision tasks. In this work, we address two critical…

Machine Learning · Computer Science 2026-04-13 Constantin Le Cleï , Nils Thuerey , Xiaoxiang Zhu

Backpropagation (BP) remains the dominant and most successful method for training parameters of deep neural network models. However, BP relies on two computationally distinct phases, does not provide a satisfactory explanation of biological…

Machine Learning · Computer Science 2025-11-12 Sander Dalm , Marcel van Gerven , Nasir Ahmad

Conventional computer vision models rely on very deep, feedforward networks processing whole images and trained offline with extensive labeled data. In contrast, biological vision relies on comparatively shallow, recurrent networks that…

Neural and Evolutionary Computing · Computer Science 2024-11-27 Osvaldo M Velarde , Lucas C Parra

Inverse problems challenge existing neural operator architectures because ill-posed inverse maps violate continuity, uniqueness, and stability assumptions. We introduce B2B${}^{-1}$, an inverse basis-to-basis neural operator framework that…

Machine Learning · Computer Science 2025-12-23 Adam J. Thorpe , Stepan Tretiakov , Dibakar Roy Sarkar , Krishna Kumar , Ufuk Topcu

Stochastic differential equations (SDEs) provide a flexible framework for modeling temporal dynamics in partially observed systems. A central task is to calibrate such models from data, which requires inferring latent trajectories and…

Machine Learning · Statistics 2026-05-08 Yu Wang , Arnab Ganguly

Parametric stochastic simulators are ubiquitous in science, often featuring high-dimensional input parameters and/or an intractable likelihood. Performing Bayesian parameter inference in this context can be challenging. We present a neural…

Machine Learning · Statistics 2021-10-27 Benjamin Kurt Miller , Alex Cole , Patrick Forré , Gilles Louppe , Christoph Weniger

Decision-Focused Learning (DFL) trains predictors to improve downstream decision quality, but computing regret gradients typically requires differentiating through solvers or relying on surrogate losses, which can be computationally…

Machine Learning · Computer Science 2026-05-20 Junhyeong Lee , Sangjin Jin , Yongjae Lee

Background: In medical imaging, images are usually treated as deterministic, while their uncertainties are largely underexplored. Purpose: This work aims at using deep learning to efficiently estimate posterior distributions of imaging…

Image and Video Processing · Electrical Eng. & Systems 2023-03-20 Xiaofeng Liu , Thibault Marin , Tiss Amal , Jonghye Woo , Georges El Fakhri , Jinsong Ouyang

In performative prediction, the deployment of a predictive model triggers a shift in the data distribution. As these shifts are typically unknown ahead of time, the learner needs to deploy a model to get feedback about the distribution it…

Machine Learning · Computer Science 2022-07-19 Meena Jagadeesan , Tijana Zrnic , Celestine Mendler-Dünner

End-to-end autonomous driving systems, predominantly trained through imitation learning, have demonstrated considerable effectiveness in leveraging large-scale expert driving data. Despite their success in open-loop evaluations, these…

Robotics · Computer Science 2025-11-12 Yi Huang , Zhan Qu , Lihui Jiang , Bingbing Liu , Hongbo Zhang

Simulation-based inference with neural posterior estimation (NPE) often yields overconfident and unreliable posteriors under limited simulation budgets. To address this, we propose DRO-NPE, a distributionally robust approach that replaces…

Machine Learning · Statistics 2026-05-28 William Laplante , Yuga Hikida , Charita Dellaporta , François-Xavier Briol , Ayush Bharti