English
Related papers

Related papers: Scalable physics-informed deep generative model fo…

200 papers

We propose a neural network-based meta-learning method to efficiently solve partial differential equation (PDE) problems. The proposed method is designed to meta-learn how to solve a wide variety of PDE problems, and uses the knowledge for…

Machine Learning · Statistics 2023-10-23 Tomoharu Iwata , Yusuke Tanaka , Naonori Ueda

Enforcing exact macroscopic conservation laws, such as mass and energy, in neural partial differential equation (PDE) solvers is computationally challenging in high dimensions. Traditional discrete projections rely on deterministic…

Machine Learning · Computer Science 2026-04-01 Zhangyong Liang

This dissertation explores how deep generative models can advance the analysis of challenging biological problems by integrating domain knowledge with deep learning. It focuses on two areas: DNA reaction kinetics and cryogenic electron…

Machine Learning · Computer Science 2026-05-07 Chenwei Zhang

The Latent Stochastic Differential Equation (SDE) is a powerful tool for time series and sequence modeling. However, training Latent SDEs typically relies on adjoint sensitivity methods, which depend on simulation and backpropagation…

Machine Learning · Statistics 2025-06-27 Grigory Bartosh , Dmitry Vetrov , Christian A. Naesseth

Considering generating samples with high rewards, we focus on optimizing deep neural networks parameterized stochastic differential equations (SDEs), the advanced generative models with high expressiveness, with policy gradient, the leading…

Machine Learning · Computer Science 2024-06-27 Xiangxin Zhou , Liang Wang , Yichi Zhou

This paper introduces a new approach to generating sample paths of unknown Markovian stochastic differential equations (SDEs) using diffusion models, a class of generative AI methods commonly employed in image and video applications. Unlike…

Machine Learning · Computer Science 2026-03-17 Xuefeng Gao , Jiale Zha , Xun Yu Zhou

Conditional generative models represent a significant advancement in the field of machine learning, allowing for the controlled synthesis of data by incorporating additional information into the generation process. In this work we introduce…

Machine Learning · Statistics 2024-09-27 Hanwen Huang

Deep learning-based techniques have potential to optimize scan and post-processing times required for MRI-based fat quantification, but they are constrained by the lack of large training datasets. Generative models are a promising tool to…

Signal Processing · Electrical Eng. & Systems 2024-12-13 Juan P. Meneses , Yasmeen George , Christoph Hagemeyer , Zhaolin Chen , Sergio Uribe

We are delighted to see the recent development of physics-informed extreme learning machine (PIELM) for its higher computational efficiency and accuracy compared to other physics-informed machine learning (PIML) paradigms. Since a…

Machine Learning · Computer Science 2025-11-04 He Yang , Fei Ren , Francesco Calabro , Hai-Sui Yu , Xiaohui Chen , Pei-Zhi Zhuang

Since the seminal work of [9] and their Physics-Informed neural networks (PINNs), many efforts have been conducted towards solving partial differential equations (PDEs) with Deep Learning models. However, some challenges remain, for…

Machine Learning · Computer Science 2023-11-27 Marien Chenaud , José Alves , Frédéric Magoulès

Graph generative models have broad applications in biology, chemistry and social science. However, modelling and understanding the generative process of graphs is challenging due to the discrete and high-dimensional nature of graphs, as…

Machine Learning · Computer Science 2022-12-06 Han Huang , Leilei Sun , Bowen Du , Yanjie Fu , Weifeng Lv

We analyze the dynamics of streaming stochastic gradient descent (SGD) in the high-dimensional limit when applied to generalized linear models and multi-index models (e.g. logistic regression, phase retrieval) with general data-covariance.…

Optimization and Control · Mathematics 2023-08-21 Elizabeth Collins-Woodfin , Courtney Paquette , Elliot Paquette , Inbar Seroussi

Causal inference is a crucial goal of science, enabling researchers to arrive at meaningful conclusions regarding the predictions of hypothetical interventions using observational data. Path models, Structural Equation Models (SEMs), and,…

Machine Learning · Statistics 2024-01-11 Matthew J. Vowels

We present a physics-informed machine-learning (PIML) approach for the approximation of slow invariant manifolds (SIMs) of singularly perturbed systems, providing functionals in an explicit form that facilitate the construction and…

Dynamical Systems · Mathematics 2024-11-05 Dimitrios G. Patsatzis , Gianluca Fabiani , Lucia Russo , Constantinos Siettos

This letter develops a novel physics-informed neural ordinary differential equations-based framework to emulate the proprietary dynamics of the inverters -- essential for improved accuracy in grid dynamic simulations. In current industry…

Systems and Control · Electrical Eng. & Systems 2025-07-22 Kyung-Bin Kwon , Sayak Mukherjee , Ramij R. Hossain , Marcelo Elizondo

This position paper argues for the use of \emph{structured generative models} (SGMs) for the understanding of static scenes. This requires the reconstruction of a 3D scene from an input image (or a set of multi-view images), whereby the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Christopher K. I. Williams

We present PDE-FM, a modular foundation model for physics-informed machine learning that unifies spatial, spectral, and temporal reasoning across heterogeneous partial differential equation (PDE) systems. PDE-FM combines spatial-spectral…

Machine Learning · Computer Science 2025-12-01 Eduardo Soares , Emilio Vital Brazil , Victor Shirasuna , Breno W. S. R. de Carvalho , Cristiano Malossi

Neural networks are one tool for approximating non-linear differential equations used in scientific computing tasks such as surrogate modeling, real-time predictions, and optimal control. PDE foundation models utilize neural networks to…

Machine Learning · Computer Science 2025-02-11 Elisa Negrini , Yuxuan Liu , Liu Yang , Stanley J. Osher , Hayden Schaeffer

We introduce a physics-driven deep latent variable model (PDDLVM) to learn simultaneously parameter-to-solution (forward) and solution-to-parameter (inverse) maps of parametric partial differential equations (PDEs). Our formulation…

Machine Learning · Statistics 2023-08-09 Arnaud Vadeboncoeur , Ömer Deniz Akyildiz , Ieva Kazlauskaite , Mark Girolami , Fehmi Cirak

Neural Stochastic Differential Equations (Neural SDEs) provide a principled framework for modeling continuous-time stochastic processes and have been widely adopted in fields ranging from physics to finance. Recent advances suggest that…

Machine Learning · Computer Science 2026-03-17 Yuanjian Xu , Yuan Shuai , Jianing Hao , Guang Zhang