English
Related papers

Related papers: Algorithms for Lipschitz Learning on Graphs

200 papers

Lipschitz decomposition is a useful tool in the design of efficient algorithms involving metric spaces. While many bounds are known for different families of finite metrics, the optimal parameters for $n$-point subsets of $\ell_p$, for $p >…

Computational Geometry · Computer Science 2026-02-23 Robert Krauthgamer , Nir Petruschka

The girth of a graph, i.e. the length of its shortest cycle, is a fundamental graph parameter. Unfortunately all known algorithms for computing, even approximately, the girth and girth-related structures in directed weighted $m$-edge and…

Data Structures and Algorithms · Computer Science 2018-08-14 Jakub Pachocki , Liam Roditty , Aaron Sidford , Roei Tov , Virginia Vassilevska Williams

This paper tackles the problem of Lipschitz regularization of Convolutional Neural Networks. Lipschitz regularity is now established as a key property of modern deep learning with implications in training stability, generalization,…

Machine Learning · Computer Science 2020-11-10 Alexandre Araujo , Benjamin Negrevergne , Yann Chevaleyre , Jamal Atif

Deep neural networks are notorious for being sensitive to small well-chosen perturbations, and estimating the regularity of such architectures is of utmost importance for safe and robust practical applications. In this paper, we investigate…

Machine Learning · Statistics 2019-10-28 Kevin Scaman , Aladin Virmaux

We give an algorithm to compute a one-dimensional shape-constrained function that best fits given data in weighted-$L_{\infty}$ norm. We give a single algorithm that works for a variety of commonly studied shape constraints including…

Data Structures and Algorithms · Computer Science 2019-05-30 David Durfee , Yu Gao , Anup B. Rao , Sebastian Wild

We consider global efficiency of algorithms for minimizing a sum of a convex function and a composition of a Lipschitz convex function with a smooth map. The basic algorithm we rely on is the prox-linear method, which in each iteration…

Optimization and Control · Mathematics 2017-08-16 Dmitriy Drusvyatskiy , Courtney Paquette

In the (special) smoothing spline problem one considers a variational problem with a quadratic data fidelity penalty and Laplacian regularisation. Higher order regularity can be obtained via replacing the Laplacian regulariser with a…

Machine Learning · Statistics 2022-09-07 Nicolás García Trillos , Ryan Murray , Matthew Thorpe

We propose a supervised learning approach for predicting an underlying graph from a set of graph signals. Our approach is based on linear regression. In the linear regression model, we predict edge-weights of a graph as the output, given a…

Information Theory · Computer Science 2018-11-06 Arun Venkitaraman , Hermina Petric Maretic , Saikat Chatterjee , Pascal Frossard

We prove Lipschitz continuity results for solutions to a class of obstacle problems under standard growth conditions of $p$-type, $p \geq 2$. The main novelty is the use of a linearization technique going back to [28] in order to interpret…

Analysis of PDEs · Mathematics 2022-10-13 Carlo Benassi , Michele Caselli

We obtain Lipschitz estimates for bounded minimizers of functionals with nonstandard $(p,q)$-growth satisfying the dimension-independent restriction $q<p+2$ with $p \geq 2$. This relation improves existing restrictions when $p \leq N-1$,…

Analysis of PDEs · Mathematics 2021-08-16 Karthik Adimurthi , Vivek Tewary

We study the problem of robustly estimating the parameter $p$ of an Erd\H{o}s-R\'enyi random graph on $n$ nodes, where a $\gamma$ fraction of nodes may be adversarially corrupted. After showing the deficiencies of canonical estimators, we…

Data Structures and Algorithms · Computer Science 2022-02-16 Jayadev Acharya , Ayush Jain , Gautam Kamath , Ananda Theertha Suresh , Huanyu Zhang

Beside the minimization of the prediction error, two of the most desirable properties of a regression scheme are stability and interpretability. Driven by these principles, we propose continuous-domain formulations for one-dimensional…

Machine Learning · Computer Science 2021-12-28 Shayan Aziznejad , Thomas Debarre , Michael Unser

This paper presents a tractable algorithm for estimating an unknown Lipschitz function from noisy observations and establishes an upper bound on its convergence rate. The approach extends max-affine methods from convex shape-restricted…

Machine Learning · Statistics 2025-11-20 Gábor Balázs

Let $P$ be a path graph of $n$ vertices embedded in a metric space. We consider the problem of adding a new edge to $P$ to minimize the radius of the resulting graph. Previously, a similar problem for minimizing the diameter of the graph…

Data Structures and Algorithms · Computer Science 2019-04-30 Christopher Johnson , Haitao Wang

In this paper we study Lipschitz regularity of elliptic PDEs on geometric graphs, constructed from random data points. The data points are sampled from a distribution supported on a smooth manifold. The family of equations that we study…

Analysis of PDEs · Mathematics 2021-10-22 Jeff Calder , Nicolas Garcia Trillos , Marta Lewicka

We provide a general approach to Lipschitz regularity of solutions for a large class of vector-valued, nonautonomous variational problems exhibiting nonuniform ellipticity. The functionals considered here range amongst those with unbalanced…

Analysis of PDEs · Mathematics 2021-08-02 Cristiana De Filippis , Giuseppe Mingione

The goal of the paper is to design sequential strategies which lead to efficient optimization of an unknown function under the only assumption that it has a finite Lipschitz constant. We first identify sufficient conditions for the…

Machine Learning · Statistics 2017-06-19 Cédric Malherbe , Nicolas Vayatis

We provide sharp worst-case evaluation complexity bounds for nonconvex minimization problems with general inexpensive constraints, i.e.\ problems where the cost of evaluating/enforcing of the (possibly nonconvex or even disconnected)…

Optimization and Control · Mathematics 2021-05-31 Coralia Cartis , Nick I. M. Gould , Philippe L. Toint

Most of lipschitz regularity results for nonlinear strictly elliptic equations are obtained for a suitable growth power of the nonlinearity with respect to the gradient variable (subquadratic for instance). For equations with superquadratic…

Analysis of PDEs · Mathematics 2016-07-14 Olivier Ley , Vinh Duc Nguyen

This paper deals with two kinds of the one-dimensional global optimization problems over a closed finite interval: (i) the objective function $f(x)$ satisfies the Lipschitz condition with a constant $L$; (ii) the first derivative of $f(x)$…

Optimization and Control · Mathematics 2013-07-15 Daniela Lera , Yaroslav D. Sergeyev