English
Related papers

Related papers: Second-order analysis of piecewise linear function…

200 papers

In this paper, we readdress the classical topic of second-order sufficient optimality conditions for optimization problems with nonsmooth structure. Based on the so-called second subderivative of the objective function and of the indicator…

Optimization and Control · Mathematics 2023-01-27 Matúš Benko , Patrick Mehlitz

In [R. Andreani, G. Haeser, L. M. Mito, H. Ram\'irez C., Weak notions of nondegeneracy in nonlinear semidefinite programming, arXiv:2012.14810, 2020] the classical notion of nondegeneracy (or transversality) and Robinson's constraint…

Optimization and Control · Mathematics 2022-04-19 Roberto Andreani , Gabriel Haeser , Héctor Ramírez C. , Leonardo M. Mito , Thiago P. Silveira

In this note, we present an elementary proof for a well-known second-order sufficient optimality condition in nonlinear semidefinite optimization which does not rely on the enhanced theory of second-order tangents. Our approach builds on an…

Optimization and Control · Mathematics 2023-02-09 Patrick Mehlitz

First-order stochastic methods are the state-of-the-art in large-scale machine learning optimization owing to efficient per-iteration complexity. Second-order methods, while able to provide faster convergence, have been much less explored…

Machine Learning · Statistics 2017-12-01 Naman Agarwal , Brian Bullins , Elad Hazan

This paper presents an innovative continuous linear finite element approach to effectively solve biharmonic problems on surfaces. The key idea behind this method lies in the strategic utilization of a surface gradient recovery operator to…

Numerical Analysis · Mathematics 2024-04-30 Ying Cai , Hailong Guo , Zhimin Zhang

We perform conformal perturbation theory by marginal operators to first order. A suitable renormalization method is needed that makes the conformal invariance of the deformed correlation functions manifest. Combining the embedding space…

High Energy Physics - Theory · Physics 2018-02-27 Kallol Sen , Yuji Tachikawa

Lie's linearizability criteria for scalar second-order ordinary differential equations had been extended to systems of second-order ordinary differential equations by using geometric methods. These methods not only yield the linearizing…

Classical Analysis and ODEs · Mathematics 2011-07-25 S. Ali , F. M. Mahomed , Asghar Qadir

The paper addresses the study and applications of a broad class of extended-real-valued functions, known as optimal value or marginal functions, which are frequently appeared in variational analysis, parametric optimization, and a variety…

Optimization and Control · Mathematics 2025-02-05 Le Phuoc Hai , Felipe Lara , Boris S. Mordukhovich

In this paper, we present a novel algorithm for piecewise linear regression which can learn continuous as well as discontinuous piecewise linear functions. The main idea is to repeatedly partition the data and learn a liner model in in each…

Machine Learning · Computer Science 2014-09-10 Naresh Manwani , P. S. Sastry

This paper studies first-order algorithms for solving fully composite optimization problems over convex and compact sets. We leverage the structure of the objective by handling its differentiable and non-differentiable components…

Optimization and Control · Mathematics 2023-07-13 Maria-Luiza Vladarean , Nikita Doikov , Martin Jaggi , Nicolas Flammarion

The paper is devoted to the study, characterizations, and applications of variational convexity of functions, the property that has been recently introduced by Rockafellar together with its strong counterpart. First we show that these…

Optimization and Control · Mathematics 2023-01-30 Pham Duy Khanh , Boris S. Mordukhovich , Vo Thanh Phat

Second-order optimality conditions of the bilevel programming problems are dependent on the second-order directional derivatives of the value functions or the solution mappings of the lower level problems under some regular conditions,…

Optimization and Control · Mathematics 2023-07-24 Xiang Liu , Mengwei Xu , Liwei Zhang

A piecewise linear function can be described in different forms: as an arbitrarily nested expression of $\min$- and $\max$-functions, as a difference of two convex piecewise linear functions, or as a linear combination of maxima of…

Symbolic Computation · Computer Science 2023-05-29 Christoph Koutschan , Bernhard Moser , Anton Ponomarchuk , Josef Schicho

For discretisations of hyperbolic conservation laws, mimicking properties of operators or solutions at the continuous (differential equation) level discretely has resulted in several successful methods. While well-posedness for nonlinear…

Numerical Analysis · Mathematics 2019-10-22 Hendrik Ranocha

The paper is devoted to a systematic study and characterizations of notions of local maximal monotonicity and their strong counterparts for set-valued operators that appear in variational analysis, optimization, and their applications. We…

Optimization and Control · Mathematics 2023-08-29 Pham Duy Khanh , Vu Vinh Huy Khoa , Boris S. Mordukhovich , Vo Thanh Phat

Second-order structured deformations of continua provide an extension of the multiscale geometry of first-order structured deformations by taking into account the effects of submacroscopic bending and curving. We derive here an integral…

Optimization and Control · Mathematics 2017-05-24 Ana Cristina Barroso , José Matias , Marco Morandotti , David R. Owen

We extend the standard notion of self-concordance to non-convex optimization and develop a family of second-order algorithms with global convergence guarantees. In particular, two function classes -- \textit{weakly self-concordant}…

Optimization and Control · Mathematics 2026-04-07 Donald Goldfarb , Lexiao Lai , Tianyi Lin , Jiayu Zhang

It is shown how piecewise differentiable functions $F: \mathbb R^n \mapsto \mathbb R^m $ that are defined by evaluation programs can be approximated locally by a piecewise linear model based on a pair of sample points $\check x$ and $\hat…

Numerical Analysis · Mathematics 2017-08-14 Andreas Griewank , Tom Streubel , Lutz Lehmann , Manuel Radons , Richard Hasenfelder

We introduce a general difference quotient representation for non-local operators associated with a first-order linear operator. We establish new local to non-local estimates and strong localization principles in various spaces of…

Analysis of PDEs · Mathematics 2024-04-26 Adolfo Arroyo-Rabasa

Second-order sufficient conditions for local optimality have been playing an important role in local convergence analysis of optimization algorithms. In this paper, we demonstrate that this condition alone suffices to justify the linear…

Optimization and Control · Mathematics 2021-05-04 Nguyen T. V. Hang , M. Ebrahim Sarabi