English
Related papers

Related papers: PDE+: Enhancing Generalization via PDE with Adapti…

200 papers

A growing body of literature has been leveraging techniques of machine learning (ML) to build novel approaches to approximating the solutions to partial differential equations. Noticeably absent from the literature is a systematic…

Numerical Analysis · Mathematics 2026-05-19 Jonah A. Reeger

Partial differential equation (PDE) models and their associated variational energy formulations are often rotationally invariant by design. This ensures that a rotation of the input results in a corresponding rotation of the output, which…

Machine Learning · Computer Science 2022-03-21 Tobias Alt , Karl Schrader , Joachim Weickert , Pascal Peter , Matthias Augustin

Adversarial images are designed to mislead deep neural networks (DNNs), attracting great attention in recent years. Although several defense strategies achieved encouraging robustness against adversarial samples, most of them fail to…

Machine Learning · Computer Science 2020-02-25 Hang Yu , Aishan Liu , Xianglong Liu , Gengchao Li , Ping Luo , Ran Cheng , Jichen Yang , Chongzhi Zhang

We present a computational technique for modeling the evolution of dynamical systems in a reduced basis, with a focus on the challenging problem of modeling partially-observed partial differential equations (PDEs) on high-dimensional…

Machine Learning · Statistics 2024-12-25 Victor Churchill

Real-noise denoising is a challenging task because the statistics of real-noise do not follow the normal distribution, and they are also spatially and temporally changing. In order to cope with various and complex real-noise, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Yoonsik Kim , Jae Woong Soh , Gu Yong Park , Nam Ik Cho

Neural networks are versatile tools for computation, having the ability to approximate a broad range of functions. An important problem in the theory of deep neural networks is expressivity; that is, we want to understand the functions that…

Machine Learning · Computer Science 2021-08-16 Khashayar Filom , Konrad Paul Kording , Roozbeh Farhoodi

This work is concerned with discovering the governing partial differential equation (PDE) of a physical system. Existing methods have demonstrated the PDE identification from finite observations but failed to maintain satisfying results…

Numerical Analysis · Mathematics 2023-02-09 Pongpisit Thanasutives , Takashi Morita , Masayuki Numao , Ken-ichi Fukui

Diffusion-based solvers for partial differential equations (PDEs) are often bottle-necked by slow gradient-based test-time optimization routines that use PDE residuals for loss guidance. They additionally suffer from optimization…

Machine Learning · Computer Science 2025-12-02 Medha Sawhney , Abhilash Neog , Mridul Khurana , Anuj Karpatne

Diffusion models have emerged as a dominant framework for generative modeling, but their mathematical foundations are often presented separately through diffusion probabilistic models, score-based modeling, stochastic differential…

Machine Learning · Computer Science 2026-05-29 Jiayi Fu , Yuxia Wang

The success of denoising diffusion models raises important questions regarding their generalisation behaviour, particularly in high-dimensional settings. Notably, it has been shown that when training and sampling are performed perfectly,…

Machine Learning · Statistics 2025-07-08 Tyler Farghly , Patrick Rebeschini , George Deligiannidis , Arnaud Doucet

In this paper, we develop an analytical framework for the partial differential equation underlying the consensus-based optimization model. The main challenge arises from the nonlinear, nonlocal nature of the consensus point, coupled with a…

Analysis of PDEs · Mathematics 2025-04-16 Jinhuan Wang , Keyu Li , Hui Huang

In this two-part paper, we propose a general algorithmic framework for the minimization of a nonconvex smooth function subject to nonconvex smooth constraints. The algorithm solves a sequence of (separable) strongly convex problems and…

Multiagent Systems · Computer Science 2016-01-18 Gesualdo Scutari , Francisco Facchinei , Lorenzo Lampariello , Peiran Song

A novel approach is suggested for improving the accuracy of fault detection in distribution networks. This technique combines adaptive probability learning and waveform decomposition to optimize the similarity of features. Its objective is…

Signal Processing · Electrical Eng. & Systems 2023-10-03 Xinliang Ma , Weihua Liu , Bingying Jin

Residual-based adaptive strategies are widely used in scientific machine learning but remain largely heuristic. We introduce a unifying variational framework that formalizes these methods by integrating convex transformations of the…

Machine Learning · Computer Science 2025-09-29 Juan Diego Toscano , Daniel T. Chen , Vivek Oommen , Jérôme Darbon , George Em Karniadakis

We propose a novel type of nonlinear solver acceleration for systems of nonlinear partial differential equations (PDEs) that is based on online/adaptive learning. It is applied in the context of multiphase flow in porous media. The proposed…

Machine Learning · Computer Science 2025-04-28 Vinicius L S Silva , Pablo Salinas , Claire E Heaney , Matthew Jackson , Christopher C Pain

Traditionally, systems governed by linear Partial Differential Equations (PDEs) are spatially discretized to exploit their algebraic structure and reduce the computational effort for controlling them. Due to beneficial insights of the PDEs,…

Systems and Control · Computer Science 2016-04-05 Saber Jafarizadeh

Solving Partial Differential Equations (PDEs) is a cornerstone of engineering and scientific research. Traditional methods for PDE solving are cumbersome, relying on manual setup and domain expertise. While Physics-Informed Neural Network…

Artificial Intelligence · Computer Science 2025-12-23 Jianming Liu , Ren Zhu , Jian Xu , Kun Ding , Xu-Yao Zhang , Gaofeng Meng , Cheng-Lin Liu

Physics-informed neural networks solve partial differential equations by training neural networks. Since this method approximates infinite-dimensional PDE solutions with finite collocation points, minimizing discretization errors by…

Machine Learning · Computer Science 2024-12-11 Takashi Matsubara , Takaharu Yaguchi

Physics-informed deep learning often faces optimization challenges due to the complexity of solving partial differential equations (PDEs), which involve exploring large solution spaces, require numerous iterations, and can lead to unstable…

Partial differential equations (PDEs) are central to scientific modeling. Modern workflows increasingly rely on learning-based components to support model reuse, inference, and integration across large computational processes. Despite the…

Machine Learning · Computer Science 2026-02-20 Yilong Dai , Shengyu Chen , Ziyi Wang , Xiaowei Jia , Yiqun Xie , Vipin Kumar , Runlong Yu