English
Related papers

Related papers: Collocation method for a functional equation arisi…

200 papers

In this paper, we revisit the classical problem of solving over-determined systems of nonsmooth equations numerically. We suggest a nonsmooth Levenberg--Marquardt method for its solution which, in contrast to the existing literature, does…

Optimization and Control · Mathematics 2023-11-10 Lateef O. Jolaoso , Patrick Mehlitz , Alain B. Zemkoho

In this review article we present regularity properties of generalized functions which are useful in the analysis of non-linear problems. It is shown that Schwartz distributions embedded into our new spaces of generalized functions, with…

Functional Analysis · Mathematics 2014-07-25 Stevan Pilipovic , Dimitris Scarpalezos , Jasson Vindas

We develop a globalized Proximal Newton method for composite and possibly non-convex minimization problems in Hilbert spaces. Additionally, we impose less restrictive assumptions on the composite objective functional considering…

Optimization and Control · Mathematics 2021-11-02 Bastian Pötzl , Anton Schiela , Patrick Jaap

We discuss technical results on learning function approximations using piecewise-linear basis functions, and analyze their stability and convergence using nonlinear contraction theory.

Optimization and Control · Mathematics 2018-04-27 Winfried Lohmiller , Philipp Gassert , Jean-Jacques Slotine

In this paper we consider the computation of approximate solutions for inverse problems in Hilbert spaces. In order to capture the special feature of solutions, non-smooth convex functions are introduced as penalty terms. By exploiting the…

Numerical Analysis · Mathematics 2015-06-18 Qinian Jin , Xiliang Lu

We propose a large-scale scaling viewpoint for deriving mesoscopic dynamics from interacting particle systems and apply it to the Cucker--Smale flocking model. In contrast with the classical mean-field regime leading to the Vlasov-type…

Analysis of PDEs · Mathematics 2026-02-17 Ruicheng Cheng , Seung-Yeal Ha , Jaemoon Lee , Zhenfu Wang

Probability functions appear in constraints of many optimization problems in practice and have become quite popular. Understanding their first-order properties has proven useful, not only theoretically but also in implementable algorithms,…

Optimization and Control · Mathematics 2023-04-21 Wim van Ackooij , Pedro Pérez-Aros , Claudia Soto

In this paper, we propose an inexact proximal Newton-type method for nonconvex composite problems. We establish the global convergence rate of the order $\mathcal{O}(k^{-1/2})$ in terms of the minimal norm of the KKT residual mapping and…

Optimization and Control · Mathematics 2024-12-26 Hong Zhu

We develop a new method to locally cluster curves and discover functional motifs, i.e.~typical ``shapes'' that may recur several times along and across the curves capturing important local characteristics. In order to identify these shared…

Methodology · Statistics 2023-01-30 Marzia A. Cremona , Francesca Chiaromonte

We show that Newton's method converges globally at a linear rate for objective functions whose Hessians are stable. This class of problems includes many functions which are not strongly convex, such as logistic regression. Our linear…

Machine Learning · Computer Science 2018-06-04 Sai Praneeth Karimireddy , Sebastian U. Stich , Martin Jaggi

This work investigates a dynamical system functioning as a nonsmooth adaptation of the continuous Newton method, aimed at minimizing the sum of a primal lower-regular and a locally Lipschitz function, both potentially nonsmooth. The…

Optimization and Control · Mathematics 2024-12-10 Juan Guillermo Garrido , Pedro Pérez-Aros , Emilio Vilches

We present a framework for performing efficient regression in general metric spaces. Roughly speaking, our regressor predicts the value at a new point by computing a Lipschitz extension --- the smoothest function consistent with the…

Machine Learning · Computer Science 2017-04-25 Lee-Ad Gottlieb , Aryeh Kontorovich , Robert Krauthgamer

The performance of standard stochastic approximation implementations can vary significantly based on the choice of the steplength sequence, and in general, little guidance is provided about good choices. Motivated by this gap, in the first…

Optimization and Control · Mathematics 2015-03-19 Farzad Yousefian , Angelia Nedić , Uday V. Shanbhag

We prove that Picard-Lindel\"of iterations for an arbitrary smooth normal Cauchy problem for PDE converge if we assume a suitable Weissinger-like sufficient condition. This condition includes both a large class of non-analytic PDE or…

Analysis of PDEs · Mathematics 2022-11-03 Paolo Giordano , Lorenzo Luperi Baglini

For solving a broad class of nonconvex programming problems on an unbounded constraint set, we provide a self-adaptive step-size strategy that does not include line-search techniques and establishes the convergence of a generic approach…

Optimization and Control · Mathematics 2022-12-14 Thang Tran Ngoc , Hai Trinh Ngoc

In this work we introduce and analyze a new multiscale method for strongly nonlinear monotone equations in the spirit of the Localized Orthogonal Decomposition. A problem-adapted multiscale space is constructed by solving linear local…

Numerical Analysis · Mathematics 2020-12-16 Barbara Verfürth

The purpose of this work is to provide an explicit construction of a strong Feller semigroup on the space of probability measures over the real line that additionally maps bounded measurable functions into Lipschitz continuous functions,…

Probability · Mathematics 2024-06-10 François Delarue , William R. P. Hammersley

Nonlocal diffusion model provides an appropriate description of the diffusion process of solute in the complex medium, which cannot be described properly by classical theory of PDE. However, the operators in the nonlocal diffusion models…

Numerical Analysis · Mathematics 2018-03-01 Hao Tian , Jing Zhang

We consider minimization of functions that are compositions of convex or prox-regular functions (possibly extended-valued) with smooth vector functions. A wide variety of important optimization problems fall into this framework. We describe…

Optimization and Control · Mathematics 2015-04-24 A. S. Lewis , S. J. Wright

By means of several examples, we motivate that universal properties are the simplest way to solve a given mathematical problem, explaining in this way why they appear everywhere in mathematics. In particular, we present the co-universal…

Functional Analysis · Mathematics 2024-04-25 Djamel eddine Kebiche , Paolo Giordano