English
Related papers

Related papers: Convergence Rate for a Radau hp Collocation Method…

200 papers

In regularized risk minimization, the associated optimization problem becomes particularly difficult when both the loss and regularizer are nonsmooth. Existing approaches either have slow or unclear convergence properties, are restricted to…

Machine Learning · Computer Science 2016-10-14 Shuai Zheng , Ruiliang Zhang , James T. Kwok

In this work, we present numerical analysis for a distributed optimal control problem, with box constraint on the control, governed by a subdiffusion equation which involves a fractional derivative of order $\alpha\in(0,1)$ in time. The…

Numerical Analysis · Mathematics 2017-12-22 Bangti Jin , Buyang Li , Zhi Zhou

The problem of finding a vector with the fewest nonzero elements that satisfies an underdetermined system of linear equations is an NP-complete problem that is typically solved numerically via convex heuristics or nicely-behaved non convex…

Optimization and Control · Mathematics 2012-05-03 Heinz H. Bauschke , D. Russell Luke , Hung M. Phan , Xianfu Wang

Given a proper convex lower semicontinuous function defined on a Hilbert space and whose solution set is supposed nonempty. For attaining a global minimizer when this convex function is continuously differentiable, we approach it by a…

Optimization and Control · Mathematics 2024-04-02 A. C. Bagy , Z. Chbani , H. Riahi

We investigate in this work the rate of convergence to equilibrium of solutions to the spatially homogeneous Landau equation with soft potentials. Firstly, we prove a polynomial in time convergence using an entropy method with some new a…

Analysis of PDEs · Mathematics 2015-03-25 Kleber Carrapatoso

This paper proposes a novel CTA (Combine-Then-Adapt)-based decentralized algorithm for solving convex composite optimization problems over undirected and connected networks. The local loss function in these problems contains both smooth and…

Optimization and Control · Mathematics 2023-03-07 Luyao Guo , Xinli Shi , Jinde Cao , Zihao Wang

In this paper, we study a variant of the quadratic penalty method for linearly constrained convex problems, which has already been widely used but actually lacks theoretical justification. Namely, the penalty parameter steadily increases…

Numerical Analysis · Mathematics 2017-11-30 Huan Li , Cong Fang , Zhouchen Lin

We consider the problem of minimizing the sum of a smooth function $h$ with a bounded Hessian, and a nonsmooth function. We assume that the latter function is a composition of a proper closed function $P$ and a surjective linear map $\cal…

Optimization and Control · Mathematics 2015-11-17 Guoyin Li , Ting Kei Pong

This paper presents a directional proximal point method (DPPM) to derive the minimum of any C1-smooth function f. The proposed method requires a function persistent a local convex segment along the descent direction at any non-critical…

Optimization and Control · Mathematics 2022-04-29 Ming-Yu Chung , Jinn Ho , Wen-Liang Hwang

Mirror descent is a well established tool for solving convex optimization problems with convex constraints. This article introduces continuous-time mirror descent dynamics for approximating optimal Markov controls for stochastic control…

Optimization and Control · Mathematics 2025-06-04 Deven Sethi , David Šiška

We study the convergence rate of Sinkhorn's algorithm for solving entropy-regularized optimal transport problems when at least one of the probability measures, $\mu$, admits a density over $\mathbb{R}^d$. For a semi-concave cost function…

Optimization and Control · Mathematics 2025-07-21 Lénaïc Chizat , Alex Delalande , Tomas Vaškevičius

We are interested in the kernel of one-dimensional diffusion equations with continuous coefficients as evaluated by means of explicit discretization schemes of uniform step $h>0$ in the limit as $h\to0$. We consider both semidiscrete…

Numerical Analysis · Mathematics 2007-11-02 Claudio Albanese

Relaxation and rounding approaches became a standard and extremely versatile tool for constrained submodular function maximization. One of the most common rounding techniques in this context are contention resolution schemes. Such schemes…

Data Structures and Algorithms · Computer Science 2019-05-22 Simon Bruggmann , Rico Zenklusen

Many statistical $M$-estimators are based on convex optimization problems formed by the combination of a data-dependent loss function with a norm-based regularizer. We analyze the convergence rates of projected gradient and composite…

Machine Learning · Statistics 2012-07-26 Alekh Agarwal , Sahand N. Negahban , Martin J. Wainwright

For nonexpansive fixed-point problems, Halpern's method with optimal parameters, its so-called H-dual algorithm, and in fact, an infinite family of algorithms containing them, all exhibit the exactly minimax optimal convergence rates. In…

Optimization and Control · Mathematics 2025-11-20 TaeHo Yoon , Ernest K. Ryu , Benjamin Grimmer

We present a novel framework for PDE-constrained $r$-adaptivity of high-order meshes. The proposed method formulates mesh movement as an optimization problem, with an objective function defined as a convex combination of a mesh quality…

Numerical Analysis · Mathematics 2025-07-03 Tzanio Kolev , Boyan Lazarov , Ketan Mittal , Mathias Schmidt , Vladimir Tomov

We study a catching-up algorithm for a class of differential inclusions driven by maximal monotone operators with continuous perturbations. Using a decomposition of the monotone operator into the closed convex hull of its single-valued part…

Optimization and Control · Mathematics 2026-04-14 Tan H. Cao , Hassan Saoud

Semidefinite programming (SDP) is a fundamental class of convex optimization problems with diverse applications in mathematics, engineering, machine learning, and related disciplines. This paper investigates the application of the…

Optimization and Control · Mathematics 2025-10-15 Zilong Cui , Ran Gu

We investigate the convergence theory of several known as well as new heuristic parameter choice rules for convex Tikhonov regularisation. The success of such methods is dependent on whether certain restrictions on the noise are satisfied.…

Numerical Analysis · Mathematics 2021-04-14 Stefan Kindermann , Kemal Raik

A mesh refinement method is developed for solving bang-bang optimal control problems using direct collocation. The method starts by finding a solution on a coarse mesh. Using this initial solution, the method then determines automatically…

Optimization and Control · Mathematics 2019-05-31 Yunus M. Agamawi , William W. Hager , Anil V. Rao