English
Related papers

Related papers: Efficient Lipschitz Extensions for High-Dimensiona…

200 papers

We design the first node-differentially private algorithm for approximating the number of connected components in a graph. Given a database representing an $n$-vertex graph $G$ and a privacy parameter $\varepsilon$, our algorithm runs in…

Data Structures and Algorithms · Computer Science 2023-04-17 Iden Kalemaj , Sofya Raskhodnikova , Adam Smith , Charalampos E. Tsourakakis

We develop fast algorithms for solving regression problems on graphs where one is given the value of a function at some vertices, and must find its smoothest possible extension to all vertices. The extension we compute is the absolutely…

Machine Learning · Computer Science 2015-07-01 Rasmus Kyng , Anup Rao , Sushant Sachdeva , Daniel A. Spielman

We present a framework for performing efficient regression in general metric spaces. Roughly speaking, our regressor predicts the value at a new point by computing a Lipschitz extension --- the smoothest function consistent with the…

Machine Learning · Computer Science 2017-04-25 Lee-Ad Gottlieb , Aryeh Kontorovich , Robert Krauthgamer

Deep neural networks (DNNs) have emerged as a popular mathematical tool for function approximation due to their capability of modelling highly nonlinear functions. Their applications range from image classification and natural language…

Machine Learning · Computer Science 2019-12-30 SiQi Zhou , Angela P. Schoellig

State-of-the-art approaches for training Differentially Private (DP) Deep Neural Networks (DNN) face difficulties to estimate tight bounds on the sensitivity of the network's layers, and instead rely on a process of per-sample gradient…

The Lipschitz constant plays a crucial role in certifying the robustness of neural networks to input perturbations. Since calculating the exact Lipschitz constant is NP-hard, efforts have been made to obtain tight upper bounds on the…

Machine Learning · Computer Science 2024-10-30 Yuezhu Xu , S. Sivaranjani

We study differentially private algorithms for analyzing graphs in the challenging setting of continual release with fully dynamic updates, where edges are inserted and deleted over time, and the algorithm is required to update the solution…

Data Structures and Algorithms · Computer Science 2025-05-16 Sofya Raskhodnikova , Teresa Anna Steiner

Motivated by growing concerns over ensuring privacy on social networks, we develop new algorithms and impossibility results for fitting complex statistical models to network data subject to rigorous privacy guarantees. We consider the…

Statistics Theory · Mathematics 2018-10-05 Christian Borgs , Jennifer Chayes , Adam Smith , Ilias Zadik

This book is devoted to finite-dimensional problems of non-convex non-smooth optimization and numerical methods for their solution. The problem of nonconvexity is studied in the book on two main models of nonconvex dependencies: these are…

Optimization and Control · Mathematics 2024-06-18 V. S. Mikhalevich , A. M. Gupal , V. I. Norkin

We propose a new framework for differentially private optimization of convex functions which are Lipschitz in an arbitrary norm $\|\cdot\|$. Our algorithms are based on a regularized exponential mechanism which samples from the density…

Machine Learning · Computer Science 2022-11-14 Sivakanth Gopi , Yin Tat Lee , Daogao Liu , Ruoqi Shen , Kevin Tian

Given a connected finite graph $G$, an integer-valued function $f$ on $V(G)$ is called $M$-Lipschitz if the value of $f$ changes by at most $M$ along the edges of $G$. In 2013, Peled, Samotij, and Yehudayoff showed that random $M$-Lipschitz…

Probability · Mathematics 2024-08-28 Robert A. Krueger , Lina Li , Jinyoung Park

The exponential mechanism is a fundamental tool of Differential Privacy (DP) due to its strong privacy guarantees and flexibility. We study its extension to settings with summaries based on infinite dimensional outputs such as with…

Cryptography and Security · Computer Science 2019-01-31 Jordan Awan , Ana Kenney , Matthew Reimherr , Aleksandra Slavković

We investigate the convergence rate of the recently proposed subgradient-push method for distributed optimization over time-varying directed graphs. The subgradient-push method can be implemented in a distributed way without requiring…

Optimization and Control · Mathematics 2015-02-17 Angelia Nedic , Alex Olshevsky

Graph algorithms are widely used for decision making and knowledge discovery. To ensure their effectiveness, it is essential that their output remains stable even when subjected to small perturbations to the input because frequent output…

Data Structures and Algorithms · Computer Science 2023-09-15 Soh Kumabe , Yuichi Yoshida

Lipschitz learning is a graph-based semi-supervised learning method where one extends labels from a labeled to an unlabeled data set by solving the infinity Laplace equation on a weighted graph. In this work we prove uniform convergence…

Numerical Analysis · Mathematics 2023-01-31 Leon Bungert , Jeff Calder , Tim Roith

Tight estimation of the Lipschitz constant for deep neural networks (DNNs) is useful in many applications ranging from robustness certification of classifiers to stability analysis of closed-loop systems with reinforcement learning…

Machine Learning · Computer Science 2023-01-18 Mahyar Fazlyab , Alexander Robey , Hamed Hassani , Manfred Morari , George J. Pappas

We give a simple, computationally efficient, and node-differentially-private algorithm for estimating the parameter of an Erdos-Renyi graph---that is, estimating p in a G(n,p)---with near-optimal accuracy. Our algorithm nearly matches the…

Data Structures and Algorithms · Computer Science 2019-05-28 Adam Sealfon , Jonathan Ullman

Attention based neural networks are state of the art in a large range of applications. However, their performance tends to degrade when the number of layers increases. In this work, we show that enforcing Lipschitz continuity by normalizing…

Machine Learning · Computer Science 2021-09-14 George Dasoulas , Kevin Scaman , Aladin Virmaux

Extending functions from boundary values plays an important role in various applications. In this thesis we consider discrete and continuous formulations of the problem based on $p$-Laplacians, in particular for $p=\infty$ and tight…

Numerical Analysis · Mathematics 2019-10-31 Johannes Hertrich

Revealing hidden geometry and topology in noisy data sets is a challenging task. Elastic principal graph is a computationally efficient and flexible data approximator based on embedding a graph into the data space and minimizing the energy…

Data Structures and Algorithms · Computer Science 2019-09-25 A. N. Gorban , E. M. Mirkes , A. Zinovyev
‹ Prev 1 2 3 10 Next ›