English
Related papers

Related papers: Fast automated adjoints for spectral PDE solvers

200 papers

An automated framework is presented for the numerical solution of optimal control problems with PDEs as constraints, in both the stationary and instationary settings. The associated code can solve both linear and non-linear problems, and…

Numerical Analysis · Mathematics 2024-09-02 Santolo Leveque , James R. Maddison , John W. Pearson

Passive radar systems can detect and track the moving targets of interest by exploiting non-cooperative illuminators-of-opportunity to transmit orthogonal frequency division multiplexing (OFDM) signals. These targets are searched using a…

Optimization and Control · Mathematics 2023-02-21 Mengjiao Shi , Yunhai Xiao , Peili Li

We consider the projected gradient algorithm for the nonconvex best subset selection problem that minimizes a given empirical loss function under an $\ell_0$-norm constraint. Through decomposing the feasible set of the given sparsity…

Optimization and Control · Mathematics 2026-02-13 Jan Harold Alcantara , Ching-pei Lee

A continuous system of moment equations is introduced that models the transverse dynamics of a beam of charged particles as it passes through an arbitrary lattice of quadrupoles and solenoids in the presence of self-fields. Then, figures of…

Accelerator Physics · Physics 2022-04-20 L. Dovlatyan , B. L. Beaudoin , S. Bernal , I. Haber , D. Sutter , T. M. Antonsen

Reconstructing PDE solutions from sparse observations is a core challenge in scientific computing. We present FM4PDE, a flow-matching generative framework that learns the joint distribution of PDE coefficients (or initial states) and…

Machine Learning · Statistics 2026-05-26 Xifeng Zhang , Jin Zhao

Many engineering and scientific fields have recently become interested in modeling terms in partial differential equations (PDEs) with neural networks, which requires solving the inverse problem of learning neural network terms from…

Machine Learning · Computer Science 2026-03-30 Konstantin Riedl , Justin Sirignano , Konstantinos Spiliopoulos

We revisit the problem of large-scale bundle adjustment and propose a technique called Multidirectional Conjugate Gradients that accelerates the solution of the normal equation by up to 61%. The key idea is that we enlarge the search space…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Simon Weber , Nikolaus Demmel , Daniel Cremers

In this paper, we propose a scalable algorithm for spectral embedding. The latter is a standard tool for graph clustering. However, its computational bottleneck is the eigendecomposition of the graph Laplacian matrix, which prevents its…

Machine Learning · Computer Science 2019-04-12 Mireille El Gheche , Giovanni Chierchia , Pascal Frossard

Diffusion-based solvers for partial differential equations (PDEs) are often bottle-necked by slow gradient-based test-time optimization routines that use PDE residuals for loss guidance. They additionally suffer from optimization…

Machine Learning · Computer Science 2025-12-02 Medha Sawhney , Abhilash Neog , Mridul Khurana , Anuj Karpatne

This paper is concerned with the theory, construction and application of variable-stepsize implicit Peer two-step methods that are super-convergent for variable stepsizes, i.e., preserve their classical order achieved for uniform stepsizes…

Optimization and Control · Mathematics 2026-02-12 Jens Lang , Bernhard A. Schmitt

Simulating the time evolution of Partial Differential Equations (PDEs) of large-scale systems is crucial in many scientific and engineering domains such as fluid dynamics, weather forecasting and their inverse optimization problems.…

Machine Learning · Computer Science 2022-10-13 Tailin Wu , Takashi Maruyama , Jure Leskovec

The efficient solution of discretisations of coupled systems of partial differential equations (PDEs) is at the core of much of numerical simulation. Significant effort has been expended on scalable algorithms to precondition Krylov…

Mathematical Software · Computer Science 2018-02-22 Robert C. Kirby , Lawrence Mitchell

Systems governed by partial differential equations (PDEs) require computationally intensive numerical solvers to predict spatiotemporal field evolution. While machine learning (ML) surrogates offer faster solutions, autoregressive inference…

Machine Learning · Computer Science 2025-07-08 Ishan Khurjekar , Indrashish Saha , Lori Graham-Brady , Somdatta Goswami

Ordinary differential equations (ODEs) are widely used to characterize the dynamics of complex systems in real applications. In this article, we propose a novel joint estimation approach for generalized sparse additive ODEs where…

Methodology · Statistics 2022-08-19 Nan Zhang , Muye Nanshan , Jiguo Cao

Stiff systems of ordinary differential equations (ODEs) and sparse training data are common in scientific problems. This paper describes efficient, implicit, vectorized methods for integrating stiff systems of ordinary differential…

Numerical Analysis · Mathematics 2023-10-16 Mark C. Messner , Tianchen Hu , Tianju Chen

Fast, gradient-based structural optimization has long been limited to a highly restricted subset of problems -- namely, density-based compliance minimization -- for which gradients can be analytically derived. For other objective functions,…

Computational Engineering, Finance, and Science · Computer Science 2024-09-17 Keith J. Lee , Yijiang Huang , Caitlin T. Mueller

Seismic traveltime tomography represents a popular and useful tool for unravelling the structure of the subsurface across the scales. In this work we address the case where the forward model is represented by the eikonal equation and derive…

Geophysics · Physics 2025-08-21 Andrea Zunino , Scott Keating , Andreas Fichtner

In distributed optimization problems, a technique called gradient coding, which involves replicating data points, has been used to mitigate the effect of straggling machines. Recent work has studied approximate gradient coding, which…

Machine Learning · Statistics 2021-08-09 Margalit Glasgow , Mary Wootters

Spike and slab priors play a key role in inducing sparsity for sparse signal recovery. The use of such priors results in hard non-convex and mixed integer programming problems. Most of the existing algorithms to solve the optimization…

Methodology · Statistics 2019-04-02 Fekadu L. Bayisa , Zhiyong Zhou , Ottmar Cronie , Jun Yu

We introduce an efficient first-order primal-dual method for the solution of nonsmooth PDE-constrained optimization problems. We achieve this efficiency through not solving the PDE or its linearisation on each iteration of the optimization…

Optimization and Control · Mathematics 2024-06-11 Bjørn Jensen , Tuomo Valkonen