English
Related papers

Related papers: Accelerated PDE's for efficient solution of regula…

200 papers

A class of mixed-order \emph{PDE}-constraint regularizer for image processing problem is proposed, generalizing the standard first order total variation $(TV)$. A semi-supervised (bilevel) training scheme, which provides a simultaneous…

Analysis of PDEs · Mathematics 2019-03-19 Pan Liu

Maps from a source manifold $ {\mathcal M}$ to a target manifold ${\mathcal N}$ appear in liquid crystals, colour image enhancement, texture mapping, brain mapping, and many other areas. A numerical framework to solve variational problems…

Numerical Analysis · Mathematics 2017-10-27 Nathan D. King , Steven J. Ruuth

In this article, we develop and present a novel regularization scheme for ill-posed inverse problems governed by nonlinear time-dependent partial differential equations (PDEs). In our recent work, we introduced a bi-level regularization…

Numerical Analysis · Mathematics 2025-07-08 Tram Thi Ngoc Nguyen

We present a family of algorithms, called descent algorithms, for optimizing convex and non-convex functions. We also introduce a new first-order algorithm, called rescaled gradient descent (RGD), and show that RGD achieves a faster…

Optimization and Control · Mathematics 2020-01-07 Ashia Wilson , Lester Mackey , Andre Wibisono

Solving time-dependent Partial Differential Equations (PDEs) using a densely discretized spatial domain is a fundamental problem in various scientific and engineering disciplines, including modeling climate phenomena and fluid dynamics.…

Machine Learning · Computer Science 2025-10-24 Jan Hagnberger , Daniel Musekamp , Mathias Niepert

We propose an extended primal-dual algorithm framework for solving a general nonconvex optimization model. This work is motivated by image reconstruction problems in a class of nonlinear imaging, where the forward operator can be formulated…

Optimization and Control · Mathematics 2024-08-28 Yu Gao , Xiaochuan Pan , Chong Chen

We present a general and automated approach for computing model gradients for PDE solvers built on sparse spectral methods, and implement this capability in the widely used open-source Dedalus framework. We apply reverse-mode automatic…

Numerical Analysis · Mathematics 2026-04-15 Calum S. Skene , Keaton J. Burns

ADCME is a novel computational framework to solve inverse problems involving physical simulations and deep neural networks (DNNs). This paper benchmarks its capability to learn spatially-varying physical fields using DNNs. We demonstrate…

Numerical Analysis · Mathematics 2020-11-25 Kailai Xu , Eric Darve

We propose a new fast algorithm for solving one of the standard approaches to ill-posed linear inverse problems (IPLIP), where a (possibly non-smooth) regularizer is minimized under the constraint that the solution explains the observations…

Optimization and Control · Mathematics 2012-10-10 Manya V. Afonso , José M. Bioucas-Dias , Mário A. T. Figueiredo

We introduce a new multi-dimensional nonlinear embedding -- Piecewise Flat Embedding (PFE) -- for image segmentation. Based on the theory of sparse signal recovery, piecewise flat embedding with diverse channels attempts to recover a…

Computer Vision and Pattern Recognition · Computer Science 2018-08-13 Chaowei Fang , Zicheng Liao , Yizhou Yu

We propose a neural network-based meta-learning method to efficiently solve partial differential equation (PDE) problems. The proposed method is designed to meta-learn how to solve a wide variety of PDE problems, and uses the knowledge for…

Machine Learning · Statistics 2023-10-23 Tomoharu Iwata , Yusuke Tanaka , Naonori Ueda

Inverse problems lie at the heart of modern imaging science, with broad applications in areas such as medical imaging, remote sensing, and microscopy. Recent years have witnessed a paradigm shift in solving imaging inverse problems, where…

Optimization and Control · Mathematics 2025-11-20 Hong Ye Tan , Subhadip Mukherjee , Junqi Tang

A fully adaptive finite volume multiresolution scheme for one-dimensional strongly degenerate parabolic equations with discontinuous flux is presented. The numerical scheme is based on a finite volume discretization using the…

Numerical Analysis · Mathematics 2008-07-03 Raimund Bürger , Ricardo Ruiz Baier , Mauricio Sepúlveda , Kai Schneider

Neural networks have emerged as promising tools for solving partial differential equations (PDEs), particularly through the application of neural operators. Training neural operators typically requires a large amount of training data to…

Machine Learning · Computer Science 2025-01-27 Chaoyu Liu , Chris Budd , Carola-Bibiane Schönlieb

Nonconvex and nonsmooth optimization problems are frequently encountered in much of statistics, business, science and engineering, but they are not yet widely recognized as a technology in the sense of scalability. A reason for this…

Optimization and Control · Mathematics 2018-01-19 Bo Jiang , Tianyi Lin , Shiqian Ma , Shuzhong Zhang

We develop an accelerated gradient descent algorithm on the Grassmann manifold to compute the subspace spanned by a number of leading eigenvectors of a symmetric positive semi-definite matrix. This has a constant cost per iteration and a…

Optimization and Control · Mathematics 2024-06-27 Foivos Alimisis , Simon Vary , Bart Vandereycken

Time-dependent partial differential equations (PDEs) are ubiquitous in science and engineering. Recently, mostly due to the high computational cost of traditional solution techniques, deep neural network based surrogates have gained…

Machine Learning · Computer Science 2023-10-24 Phillip Lippe , Bastiaan S. Veeling , Paris Perdikaris , Richard E. Turner , Johannes Brandstetter

In this work we propose an efficient stochastic plug-and-play (PnP) algorithm for imaging inverse problems. The PnP stochastic gradient descent methods have been recently proposed and shown improved performance in some imaging applications…

Optimization and Control · Mathematics 2020-06-24 Junqi Tang , Mike Davies

Incorporating a deep generative model as the prior distribution in inverse problems has established substantial success in reconstructing images from corrupted observations. Notwithstanding, the existing optimization approaches use gradient…

Machine Learning · Computer Science 2023-01-31 Tianci Liu , Tong Yang , Quan Zhang , Qi Lei

Alternating gradient-descent-ascent (AltGDA) is an optimization algorithm that has been widely used for model training in various machine learning applications, which aims to solve a nonconvex minimax optimization problem. However, the…

Machine Learning · Computer Science 2022-05-23 Ziyi Chen , Shaocong Ma , Yi Zhou