English
Related papers

Related papers: Fast automated adjoints for spectral PDE solvers

200 papers

In recent years, considerable attention has been devoted to the regularization models due to the presence of high-dimensional data in scientific research. Sparse support vector machine (SVM) are useful tools in high-dimensional data…

Computation · Statistics 2023-12-27 Jiawei Wen

This paper presents a numerical method for variable coefficient elliptic PDEs with mostly smooth solutions on two dimensional domains. The PDE is discretized via a multi-domain spectral collocation method of high local order (order 30 and…

Numerical Analysis · Mathematics 2016-12-09 Tracy Babb , Adrianna Gillman , Sijia Hao , Per-Gunnar Martinsson

We present DeGAS, a differentiable Gaussian approximate semantics for loopless probabilistic programs that enables sample-free, gradient-based optimization in models with both continuous and discrete components. DeGAS evaluates programs…

Programming Languages · Computer Science 2026-01-22 Francesca Randone , Romina Doz , Mirco Tribastone , Luca Bortolussi

Constructing fast samplers for unconditional diffusion and flow-matching models has received much attention recently; however, existing methods for solving inverse problems, such as super-resolution, inpainting, or deblurring, still require…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Kushagra Pandey , Ruihan Yang , Stephan Mandt

In a Hilbert setting, for convex differentiable optimization, we develop a general framework for adaptive accelerated gradient methods. They are based on damped inertial dynamics where the coefficients are designed in a closed-loop way.…

Optimization and Control · Mathematics 2025-01-28 Hedy Attouch , Radu Ioan Bot , Dang-Khoa Nguyen

We propose a framework for training neural networks that are coupled with partial differential equations (PDEs) in a parallel computing environment. Unlike most distributed computing frameworks for deep neural networks, our focus is to…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-25 Kailai Xu , Weiqiang Zhu , Eric Darve

This document, as the title stated, is meant to provide a vectorized implementation of adjoint dynamics calculation for Graph Convolutional Neural Ordinary Differential Equations (GCDE). The adjoint sensitivity method is the gradient…

Machine Learning · Computer Science 2022-09-16 Jack Cai

Autonomous systems are composed of several subsystems such as mechanical, propulsion, perception, planning and control. These are traditionally designed separately which makes performance optimization of the integrated system a significant…

Robotics · Computer Science 2022-03-01 Hongrui Zheng , Johannes Betz , Rahul Mangharam

The implementation of the discrete adjoint method for exponential time differencing (ETD) schemes is considered. This is important for parameter estimation problems that are constrained by stiff time-dependent PDEs when the discretized PDE…

Optimization and Control · Mathematics 2016-10-11 Kai Rothauge , Eldad Haber , Uri Ascher

In this paper, we present numerical methods suitable for solving convex quadratic Fractional Differential Equation (FDE) constrained optimization problems, with box constraints on the state and/or control variables. We develop an…

Optimization and Control · Mathematics 2021-02-01 Spyridon Pougkakiotis , John W. Pearson , Santolo Leveque , Jacek Gondzio

We develop and analyze an asynchronous algorithm for distributed convex optimization when the objective writes a sum of smooth functions, local to each worker, and a non-smooth function. Unlike many existing methods, our distributed…

Optimization and Control · Mathematics 2019-12-13 Konstantin Mishchenko , Franck Iutzeler , Jérôme Malick

We deal with the numerical solution of linear partial differential equations (PDEs) with focus on the goal-oriented error estimates including algebraic errors arising by an inaccurate solution of the corresponding algebraic systems. The…

Numerical Analysis · Mathematics 2020-01-08 Vít Dolejší , Petr Tichý

There is a growing literature adopting a stochastic optimal control (SOC) perspective to fine-tune diffusion models and related generative policies. A prominent class of methods, known as iterative diffusion optimization, solves the SOC…

Optimization and Control · Mathematics 2026-03-24 Yuhang Mei , Amirhossein Taghvaei

Recently, a lot of papers proposed to use neural networks to approximately solve partial differential equations (PDEs). Yet, there has been a lack of flexible framework for convenient experimentation. In an attempt to fill the gap, we…

Machine Learning · Computer Science 2019-09-26 Alexander Koryagin , Roman Khudorozkov , Sergey Tsimfer

Recently, researchers have utilized neural networks to accurately solve partial differential equations (PDEs), enabling the mesh-free method for scientific computation. Unfortunately, the network performance drops when encountering a high…

Machine Learning · Computer Science 2021-09-29 Pongpisit Thanasutives , Masayuki Numao , Ken-ichi Fukui

Global spectral methods offer the potential to compute solutions of partial differential equations numerically to very high accuracy. In this work, we develop a novel global spectral method for linear partial differential equations on cubes…

Numerical Analysis · Mathematics 2022-10-25 Christoph Strössner , Daniel Kressner

In this paper, we propose a mesh-free numerical method for solving elliptic PDEs on unknown manifolds, identified with randomly sampled point cloud data. The PDE solver is formulated as a spectral method where the test function space is the…

Numerical Analysis · Mathematics 2023-05-03 Qile Yan , Shixiao Jiang , John Harlim

It is now a noticeable trend in High Performance Computing that the systems are becoming more and more heterogeneous. Compute nodes with a host CPU are being equipped with accelerators, the latter being a GPU or FPGA cards or both. In many…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-16 G. Korcyl , P. Korcyl

Fast and accurate simulation of dynamical systems is a fundamental challenge across scientific and engineering domains. Traditional numerical integrators often face a trade-off between accuracy and computational efficiency, while existing…

Computational Engineering, Finance, and Science · Computer Science 2026-03-06 Jiaxin Yuan , Haizhao Yang , Maria Cameron

Convolutional sparse representation (CSR), shift-invariant model for inverse problems, has gained much attention in the fields of signal/image processing, machine learning and computer vision. The most challenging problems in CSR implies…

Machine Learning · Computer Science 2020-11-23 Gustavo Silva , Paul Rodriguez