English
Related papers

Related papers: Complexity analysis of regularization methods for …

200 papers

Partial Differential Equations (PDEs) are central to science and engineering. Since solving them is computationally expensive, a lot of effort has been put into approximating their solution operator via both traditional and recently…

Machine Learning · Computer Science 2025-02-14 Alessandro Longhi , Danny Lathouwers , Zoltán Perkó

We consider the NP-hard problem of minimizing a convex quadratic function over the integer lattice ${\bf Z}^n$. We present a simple semidefinite programming (SDP) relaxation for obtaining a nontrivial lower bound on the optimal value of the…

Optimization and Control · Mathematics 2017-03-16 Jaehyun Park , Stephen Boyd

Linear elastic fracture mechanics admit analytic solutions that have low regularity at crack tips. Current numerical methods for partial differential equations (PDEs) of this type suffer from the constraint of such low regularity, and fail…

Numerical Analysis · Mathematics 2016-11-29 Y. C. Zhou , Varun Gupta

This work proposes a sampling-based (non-intrusive) approach within the context of low-rank separated representations to tackle the issue of curse-of-dimensionality associated with the solution of models, e.g., PDEs/ODEs, with…

Mathematical Physics · Physics 2013-06-20 Alireza Doostan , AbdoulAhad Validi , Gianluca Iaccarino

Solving inverse and optimization problems over solutions of nonlinear partial differential equations (PDEs) on complex spatial domains is a long-standing challenge. Here we introduce a method that parameterizes the solution using spectral…

Numerical Analysis · Mathematics 2025-10-30 James V. Roggeveen , Michael P. Brenner

Sparse estimation methods are aimed at using or obtaining parsimonious representations of data or models. They were first dedicated to linear variable selection but numerous extensions have now emerged such as structured sparsity or kernel…

Machine Learning · Computer Science 2011-11-24 Francis Bach , Rodolphe Jenatton , Julien Mairal , Guillaume Obozinski

We study sparse solutions of optimal control problems governed by PDEs with uncertain coefficients. We propose two formulations, one where the solution is a deterministic control optimizing the mean objective, and a formulation aiming at…

Numerical Analysis · Mathematics 2018-11-20 Chen Li , Georg Stadler

We consider solving equality-constrained nonlinear, nonconvex optimization problems. This class of problems appears widely in a variety of applications in machine learning and engineering, ranging from constrained deep neural networks, to…

Optimization and Control · Mathematics 2023-05-31 Ilgee Hong , Sen Na , Michael W. Mahoney , Mladen Kolar

We expose in a tutorial fashion the mechanisms which underlie the synthesis of optimization algorithms based on dynamic integral quadratic constraints. We reveal how these tools from robust control allow to design accelerated gradient…

Optimization and Control · Mathematics 2023-09-18 Carsten W. Scherer , Christian Ebenbauer , Tobias Holicki

We present a novel variational quantum framework for nonlinear partial differential equation (PDE) constrained optimization problems. The proposed work extends the recently introduced bi-level variational quantum PDE constrained…

Quantum Physics · Physics 2024-10-18 Abeynaya Gnanasekaran , Amit Surana , Hongyu Zhu

We overview a series of recent works addressing numerical simulations of partial differential equations in the presence of some elements of randomness. The specific equations manipulated are linear elliptic, and arise in the context of…

Numerical Analysis · Mathematics 2016-04-19 Claude Le Bris , Frederic Legoll

High-order tensor methods for solving both convex and nonconvex optimization problems have generated significant research interest, leading to algorithms with optimal global rates of convergence and local rates that are faster than Newton's…

Optimization and Control · Mathematics 2023-12-25 Wenqi Zhu , Coralia Cartis

In this paper, we consider a nonconvex optimization problem with nonlinear equality constraints. We assume that both, the objective function and the functional constraints are locally smooth. For solving this problem, we propose a…

Optimization and Control · Mathematics 2025-05-08 Lahcen El Bourkhissi , Ion Necoara

We study a family of (potentially non-convex) constrained optimization problems with convex composite structure. Through a novel analysis of non-smooth geometry, we show that proximal-type algorithms applied to exact penalty formulations of…

Optimization and Control · Mathematics 2019-03-04 Yu Bai , John Duchi , Song Mei

Regularization is a powerful technique for extracting useful information from noisy data. Typically, it is implemented by adding some sort of norm constraint to an objective function and then exactly optimizing the modified objective…

Data Structures and Algorithms · Computer Science 2011-04-28 Michael W. Mahoney , Lorenzo Orecchia

Recent years have seen the emergence of nonlinear methods for solving partial differential equations (PDEs), such as physics-informed neural networks (PINNs). While these approaches often perform well in practice, their theoretical analysis…

Numerical Analysis · Mathematics 2025-08-27 Alexandre Magueresse , Santiago Badia

When modeling scientific and industrial problems, geometries are typically modeled by explicit boundary representations obtained from computer-aided design software. Unfitted (also known as embedded or immersed) finite element methods offer…

Computational Engineering, Finance, and Science · Computer Science 2024-05-24 Pere A. Martorell , Santiago Badia

This work introduces a new cubic regularization method for nonconvex unconstrained multiobjective optimization problems. At each iteration of the method, a model associated with the cubic regularization of each component of the objective…

Optimization and Control · Mathematics 2025-06-11 Douglas S. Gonçalves , Max L. N. Gonçalves , Jefferson G. Melo

In this work we are interested in the problems of supervised learning and variable selection when the input-output dependence is described by a nonlinear function depending on a few variables. Our goal is to consider a sparse nonparametric…

Machine Learning · Statistics 2012-08-14 Lorenzo Rosasco , Silvia Villa , Sofia Mosci , Matteo Santoro , Alessandro verri

A sequential quadratic programming method is designed for solving general smooth nonlinear stochastic optimization problems subject to expectation equality constraints. We consider the setting where the objective and constraint function…

Optimization and Control · Mathematics 2026-03-17 Haoming Shen , Yang Zeng , Baoyu Zhou
‹ Prev 1 3 4 5 6 7 10 Next ›