English
Related papers

Related papers: Fast automated adjoints for spectral PDE solvers

200 papers

Diffusion models have quickly become some of the most popular and powerful generative models for high-dimensional data. The key insight that enabled their development was the realization that access to the score -- the gradient of the…

Machine Learning · Computer Science 2025-12-01 Zhenghan Fang , Mateo Díaz , Sam Buchanan , Jeremias Sulam

Neural networks have shown promising potential in accelerating the numerical simulation of systems governed by partial differential equations (PDEs). Different from many existing neural network surrogates operating on high-dimensional…

Machine Learning · Computer Science 2025-01-09 Zijie Li , Saurabh Patil , Francis Ogoke , Dule Shu , Wilson Zhen , Michael Schneier , John R. Buchanan, , Amir Barati Farimani

We present a general and scalable framework for the automated discovery of optimal meta-solvers for the solution of time-dependent nonlinear partial differential equations after appropriate discretization. By integrating classical numerical…

Numerical Analysis · Mathematics 2025-07-02 Youngkyu Lee , Shanqing Liu , Jerome Darbon , George Em Karniadakis

In this work we propose an efficient stochastic plug-and-play (PnP) algorithm for imaging inverse problems. The PnP stochastic gradient descent methods have been recently proposed and shown improved performance in some imaging applications…

Optimization and Control · Mathematics 2020-06-24 Junqi Tang , Mike Davies

This paper aims to present a fairly accessible generalization of several symmetric Gauss-Seidel decomposition based multi-block proximal alternating direction methods of multipliers (ADMMs) for convex composite optimization problems. The…

Optimization and Control · Mathematics 2020-06-09 Liang Chen , Defeng Sun , Kim-Chuan Toh , Ning Zhang

We introduce an efficient open-source python package for the inverse design of three-dimensional photonic nanostructures using the Finite-Difference Time-Domain (FDTD) method. Leveraging a flexible reverse-mode automatic differentiation…

Stencil loops are a common motif in computations including convolutional neural networks, structured-mesh solvers for partial differential equations, and image processing. Stencil loops are easy to parallelise, and their fast execution is…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-07-08 Jan Hückelheim , Navjot Kukreja , Sri Hari Krishna Narayanan , Fabio Luporini , Gerard Gorman , Paul Hovland

We propose a PDE-based accelerated gradient algorithm for optimal feedback controls of McKean-Vlasov dynamics that involve mean-field interactions both in the state and action. The method exploits a forward-backward splitting approach and…

Optimization and Control · Mathematics 2024-05-03 Christoph Reisinger , Wolfgang Stockinger , Yufei Zhang

A spectral method for solving linear partial differential equations (PDEs) with variable coefficients and general boundary conditions defined on rectangular domains is described, based on separable representations of partial differential…

Numerical Analysis · Mathematics 2016-05-04 Alex Townsend , Sheehan Olver

Accuracy in neural PDE solvers often breaks down not because of limited expressivity, but due to poor optimisation caused by ill-conditioning, especially in multi-fidelity and stiff problems. We study this issue in Physics-Informed Extreme…

Machine Learning · Computer Science 2025-08-11 Siddharth Rout

We consider structured optimisation problems defined in terms of the sum of a smooth and convex function, and a proper, l.s.c., convex (typically non-smooth) one in reflexive variable exponent Lebesgue spaces $L_{p(\cdot)}(\Omega)$. Due to…

Optimization and Control · Mathematics 2022-11-10 Marta Lazzaretti , Luca Calatroni , Claudio Estatico

We address the problem of simultaneously recovering a sequence of point source signals from observations limited to the low-frequency end of the spectrum of their summed convolution, where the point spread functions (PSFs) are unknown. By…

Information Theory · Computer Science 2024-07-16 Jinchi Chen

Fractional-order differential equations (FDEs) enhance traditional differential equations by extending the order of differential operators from integers to real numbers, offering greater flexibility in modeling complex dynamical systems…

Machine Learning · Computer Science 2025-03-24 Qiyu Kang , Xuhao Li , Kai Zhao , Wenjun Cui , Yanan Zhao , Weihua Deng , Wee Peng Tay

We study linear abstract differential-algebraic equations (ADAEs), and we introduce an index concept which is based on polynomial growth of a~pseudo-resolvent. Our approach to solvability analysis is based on degenerate semigroups. We apply…

Functional Analysis · Mathematics 2023-12-06 Hannes Gernandt , Timo Reis

Delay Differential Equations (DDEs) are a class of differential equations that can model diverse scientific phenomena. However, identifying the parameters, especially the time delay, that make a DDE's predictions match experimental results…

Machine Learning · Computer Science 2024-05-16 Robert Stephany

This work presents a non-intrusive surrogate modeling scheme based on machine learning technology for predictive modeling of complex systems, described by parametrized time-dependent PDEs. For these problems, typical finite element…

Numerical Analysis · Mathematics 2021-04-26 Stefanos Nikolopoulos , Ioannis Kalogeris , Vissarion Papadopoulos

The solution of systems of non-autonomous linear ordinary differential equations is crucial in a variety of applications, such us nuclear magnetic resonance spectroscopy. A new method with spectral accuracy has been recently introduced in…

Numerical Analysis · Mathematics 2022-10-14 Stefano Pozza , Niel Van Buggenhout

In this work, we propose a new deep learning-based scheme for solving high dimensional nonlinear backward stochastic differential equations (BSDEs). The idea is to reformulate the problem as a global optimization, where the local loss…

Numerical Analysis · Mathematics 2024-04-18 Lorenc Kapllani , Long Teng

The paper describes a sparse direct solver for the linear systems that arise from the discretization of an elliptic PDE on a two dimensional domain. The scheme decomposes the domain into thin subdomains, or ``slabs'' and uses a two-level…

Numerical Analysis · Mathematics 2025-09-01 Anna Yesypenko , Per-Gunnar Martinsson

PDE-constrained inverse problems are some of the most challenging and computationally demanding problems in computational science today. Fine meshes that are required to accurately compute the PDE solution introduce an enormous number of…

Numerical Analysis · Mathematics 2023-04-12 Jonathan Wittmer , Jacob Badger , Hari Sundar , Tan Bui-Thanh