English
Related papers

Related papers: Accelerated Optimization in the PDE Framework: For…

200 papers

Anderson acceleration is an effective technique for enhancing the efficiency of fixed-point iterations; however, analyzing its convergence in nonsmooth settings presents significant challenges. In this paper, we investigate a class of…

Optimization and Control · Mathematics 2024-10-16 Kexin Li , Luwei Bai , Xiao Wang , Hao Wang

We present a unifying framework for adapting the update direction in gradient-based iterative optimization methods. As natural special cases we re-derive classical momentum and Nesterov's accelerated gradient method, lending a new intuitive…

Machine Learning · Statistics 2016-07-12 Aleksandar Botev , Guy Lever , David Barber

Many real-world applications require solving families of expensive multi-objective optimization problems~(EMOPs) under varying operational conditions. This can be formulated as parametric expensive multi-objective optimization problems…

Machine Learning · Computer Science 2026-05-11 Tingyang Wei , Jiao Liu , Abhishek Gupta , Chin Chun Ooi , Puay Siew Tan , Yew-Soon Ong

In numerous robotics and mechanical engineering applications, among others, data is often constrained on smooth manifolds due to the presence of rotational degrees of freedom. Common datadriven and learning-based methods such as neural…

Optimization and Control · Mathematics 2023-05-16 Karthik Elamvazhuthi , Xuechen Zhang , Samet Oymak , Fabio Pasqualetti

Physics-based models often involve large systems of parametrized partial differential equations, where design parameters control various properties. However, high-fidelity simulations of such systems on large domains or with high grid…

Computational Physics · Physics 2025-05-15 Diba Behnoudfar

The problem of minimizing a separable convex function under linearly coupled constraints arises from various application domains such as economic systems, distributed control, and network flow. The main challenge for solving this problem is…

Optimization and Control · Mathematics 2017-09-05 Qin Fan , Min Xu , Yiming Ying

We provide improved convergence rates for various \emph{non-smooth} optimization problems via higher-order accelerated methods. In the case of $\ell_\infty$ regression, we achieves an $O(\epsilon^{-4/5})$ iteration complexity, breaking the…

Optimization and Control · Mathematics 2019-06-05 Brian Bullins , Richard Peng

In a Hilbert setting, we develop a gradient-based dynamic approach for fast solving convex optimization problems. By applying time scaling, averaging, and perturbation techniques to the continuous steepest descent (SD), we obtain…

Optimization and Control · Mathematics 2023-05-05 Hedy Attouch , Radu Ioan Bot , Dang-Khoa Nguyen

In this paper we present a shape optimization scheme which utilizes the alternating direction method of multipliers (ADMM) to approximate a direction of steepest descent in $W^{1,\infty}$. The followed strategy is a combination of the…

Optimization and Control · Mathematics 2025-08-26 Philip J. Herbert , Jose A. Pinzon Escobar , Martin Siebenborn

A numerical method for coupled 3D-1D problems with discontinuous solutions at the interfaces is derived and discussed. This extends a previous work on the subject where only continuous solutions were considered. Thanks to properly defined…

Numerical Analysis · Mathematics 2022-03-04 Stefano Berrone , Denise Grappein , Stefano Scialò

We combine the parameterization method for invariant manifolds with the finite element method for elliptic PDEs,to obtain a new computational framework for high order approximation of invariant manifolds attached to unstable equilibrium…

Dynamical Systems · Mathematics 2022-03-08 Jorge Gonzalez , J. D Mireles-James , Necibe Tuncer

We present a novel framework for PDE-constrained $r$-adaptivity of high-order meshes. The proposed method formulates mesh movement as an optimization problem, with an objective function defined as a convex combination of a mesh quality…

Numerical Analysis · Mathematics 2025-07-03 Tzanio Kolev , Boyan Lazarov , Ketan Mittal , Mathias Schmidt , Vladimir Tomov

Physics-informed neural networks (PINNs) effectively embed physical principles into machine learning, but often struggle with complex or alternating geometries. We propose a novel method for integrating geometric transformations within…

Machine Learning · Computer Science 2023-11-30 Samuel Burbulla

A global optimization framework, acronymed COMBEO (Change OfMeasure Based Evolutionary Optimization), is proposed. An important aspect in the development is a set of derivative-free additive directional terms obtainable through a change of…

Methodology · Statistics 2014-11-10 Saikat Sarkar , Debasish Roy

Time series alignment methods call for highly expressive, differentiable and invertible warping functions which preserve temporal topology, i.e diffeomorphisms. Diffeomorphic warping functions can be generated from the integration of…

Machine Learning · Computer Science 2022-06-17 Iñigo Martinez , Elisabeth Viles , Igor G. Olaizola

This paper presents a novel numerical optimisation method for infinite dimensional optimisation. The functional optimisation makes minimal assumptions about the functional and without any specific knowledge on the derivative of the…

Optimization and Control · Mathematics 2016-11-18 Muhammad F. Kasim , Peter A. Norreys

In this work, we illustrate an example of estimating the macro-model of velocities in the subsurface through the use of global optimization methods (GOMs). The optimization problem is solved using DEAP (Distributed Evolutionary Algorithms…

Geophysics · Physics 2019-05-31 Oscar F. Mojica , Navjot Kukreja

We introduce a generalized machine learning framework to probabilistically parameterize upper-scale models in the form of nonlinear PDEs consistent with a continuum theory, based on coarse-grained atomistic simulation data of mechanical…

In this article we propose a scalable shape optimization algorithm which is tailored for large scale problems and geometries represented by hierarchically refined meshes. Weak scalability and grid independent convergence is achieved via a…

Optimization and Control · Mathematics 2022-05-09 Jose Pinzon , Martin Siebenborn

In this work, we consider methods for solving large-scale optimization problems with a possibly nonsmooth objective function. The key idea is to first specify a class of optimization algorithms using a generic iterative scheme involving…

Optimization and Control · Mathematics 2020-02-19 Sebastian Banert , Axel Ringh , Jonas Adler , Johan Karlsson , Ozan Öktem