English
Related papers

Related papers: Multiple Scale Methods For Optimization Of Discret…

200 papers

We present and analyze a multiscale method for wave propagation problems, posed on spatial networks. By introducing a coarse scale, using a finite element space interpolated onto the network, we construct a discrete multiscale space using…

Numerical Analysis · Mathematics 2023-04-12 Morgan Görtz , Per Ljung , Axel Målqvist

The necessity to find the global optimum of multiextremal functions arises in many applied problems where finding local solutions is insufficient. One of the desirable properties of global optimization methods is \emph{strong homogeneity}…

Optimization and Control · Mathematics 2018-01-17 Yaroslav D. Sergeyev , Dmitri E. Kvasov , Marat S. Mukhametzhanov

We introduce LiPopt, a polynomial optimization framework for computing increasingly tighter upper bounds on the Lipschitz constant of neural networks. The underlying optimization problems boil down to either linear (LP) or semidefinite…

Machine Learning · Computer Science 2020-04-21 Fabian Latorre , Paul Rolland , Volkan Cevher

We consider the problem of discretizing one-dimensional, real-valued functions as graphs. The goal is to find a small set of points, from which we can approximate the remaining function values. The method for approximating the unknown…

Numerical Analysis · Mathematics 2023-06-01 John Paul Ward

We address composite optimization problems, which consist in minimizing the sum of a smooth and a merely lower semicontinuous function, without any convexity assumptions. Numerical solutions of these problems can be obtained by proximal…

Optimization and Control · Mathematics 2024-02-14 Alberto De Marchi

We study differentiable strongly quasiconvex functions for providing new properties for algorithmic and monotonicity purposes. Furthemore, we provide insights into the decreasing behaviour of strongly quasiconvex functions, applying this…

Optimization and Control · Mathematics 2024-10-07 Felipe Lara , Raúl T. Marcavillaca , Phan T. Vuong

Gradient-based methods are widely used to solve various optimization problems, however, they are either constrained by local optima dilemmas, simple convex constraints, and continuous differentiability requirements, or limited to…

Machine Learning · Computer Science 2026-03-19 Ming Li

We consider the problem of minimizing a convex function that depends on an uncertain parameter $\theta$. The uncertainty in the objective function means that the optimum, $x^*(\theta)$, is also a function of $\theta$. We propose an…

Optimization and Control · Mathematics 2022-07-06 Conor McMeel , Panos Parpas

In this paper, we provide a generalization of the forward-backward splitting algorithm for minimizing the sum of a proper convex lower semicontinuous function and a differentiable convex function whose gradient satisfies a locally…

Optimization and Control · Mathematics 2023-06-29 Luis M. Briceno-Arias , Francisco José Silva , Xianjin Yang

In this paper, global optimization (GO) Lipschitz problems are considered where the multi-dimensional multiextremal objective function is determined over a hyperinterval. An efficient one-dimensional GO method using local tuning on the…

Optimization and Control · Mathematics 2011-03-21 Dmitri E. Kvasov , Clara Pizzuti , Yaroslav D. Sergeyev

We consider a stochastic version of the proximal point algorithm for optimization problems posed on a Hilbert space. A typical application of this is supervised learning. While the method is not new, it has not been extensively analyzed in…

Optimization and Control · Mathematics 2021-09-28 Monika Eisenmann , Tony Stillfjord , Måns Williamson

This paper presents an algorithmic framework for solving unconstrained stochastic optimization problems using only stochastic function evaluations. We employ central finite-difference based gradient estimation methods to approximate the…

Optimization and Control · Mathematics 2025-01-14 Raghu Bollapragada , Cem Karamanli

We develop a numerical strategy to solve multi-dimensional Poisson equations on dynamically adapted grids for evolutionary problems disclosing propagating fronts. The method is an extension of the multiresolution finite volume scheme used…

Analysis of PDEs · Mathematics 2015-05-12 Max Duarte , Zdenek Bonaventura , Marc Massot , Anne Bourdon

In this paper some adaptive mirror descent algorithms for problems of minimization convex objective functional with several convex Lipschitz (generally, non-smooth) functional constraints are considered. It is shown that the methods are…

Optimization and Control · Mathematics 2018-12-20 F. S. Stonyakin , M . S. Alkousa , A. A. Titov

Subgradient methods comprise a fundamental class of nonsmooth optimization algorithms. Classical results show that certain subgradient methods converge sublinearly for general Lipschitz convex functions and converge linearly for convex…

Optimization and Control · Mathematics 2022-01-13 Vasileios Charisopoulos , Damek Davis

We are concerned with decentralized optimization over a compact submanifold, where the loss functions of local datasets are defined by their respective local datasets. A key challenge in decentralized optimization is mitigating the…

Optimization and Control · Mathematics 2024-07-15 Jiang Hu , Kangkang Deng

Parallelization is a popular strategy for improving the performance of iterative algorithms. Optimization methods are no exception: design of efficient parallel optimization methods and tight analysis of their theoretical properties are…

Optimization and Control · Mathematics 2023-11-28 Alexander Tyurin , Peter Richtárik

The design of fast solvers for isogeometric analysis is receiving a lot of attention due to the challenge that offers to find an algorithm with a robust convergence with respect to the spline degree. Here, we analyze the application of…

Numerical Analysis · Mathematics 2018-06-18 Álvaro Pé de la Riva , Carmen Rodrigo , Francisco J. Gaspar

We present an iterative scheme, reminiscent of the Multigrid method, to solve large boundary value problems with Probabilistic Domain Decomposition (PDD). In it, increasingly accurate approximations to the solution are used as control…

Numerical Analysis · Mathematics 2017-01-06 Francisco Bernal , Juan A. Acebrón

The discretization of velocity space plays a crucial role in the accuracy and efficiency of multiscale Boltzmann solvers. Conventional velocity space discretization methods suffer from uneven node distribution and mismatch issues, limiting…

Numerical Analysis · Mathematics 2025-11-04 Shanshan Dong , Lu Wang , Xiangxiang Chen , Guanqing Wang