English
Related papers

Related papers: Private graphon estimation via sum-of-squares

200 papers

The modular decomposition is a technique that applies but is not restricted to graphs. The notion of module naturally appears in the proofs of many graph theoretical theorems. Computing the modular decomposition tree is an important…

Discrete Mathematics · Computer Science 2009-12-10 Michel Habib , Christophe Paul

We study spectral graph clustering under edge differential privacy. We propose a matrix shuffling mechanism that combines randomized edge flipping with a random permutation of the adjacency matrix. While edge flipping alone provides only a…

Information Theory · Computer Science 2026-05-12 Antti Koskela , Mohamed Seif , H. Vincent Poor , Andrea J. Goldsmith

In this letter, we propose an algorithm for learning a sparse weighted graph by estimating its adjacency matrix under the assumption that the observed signals vary smoothly over the nodes of the graph. The proposed algorithm is based on the…

Signal Processing · Electrical Eng. & Systems 2022-05-11 Ghania Fatima , Aakash Arora , Prabhu Babu , Petre Stoica

In this work, we investigate stochastic quasi-Newton methods for minimizing a finite sum of cost functions over a decentralized network. In Part I, we develop a general algorithmic framework that incorporates stochastic quasi-Newton…

Optimization and Control · Mathematics 2023-03-22 Jiaojiao Zhang , Huikang Liu , Anthony Man-Cho So , Qing Ling

Network analysis is becoming one of the most active research areas in statistics. Significant advances have been made recently on developing theories, methodologies and algorithms for analyzing networks. However, there has been little…

Statistics Theory · Mathematics 2015-11-18 Chao Gao , Yu Lu , Harrison H. Zhou

Motivated by applications of large embedding models, we study differentially private (DP) optimization problems under sparsity of individual gradients. We start with new near-optimal bounds for the classic mean estimation problem but with…

Machine Learning · Computer Science 2024-11-01 Badih Ghazi , Cristóbal Guzmán , Pritish Kamath , Ravi Kumar , Pasin Manurangsi

We consider the basic problem of learning Single-Index Models with respect to the square loss under the Gaussian distribution in the presence of adversarial label noise. Our main contribution is the first computationally efficient algorithm…

Machine Learning · Computer Science 2025-08-07 Puqian Wang , Nikos Zarifis , Ilias Diakonikolas , Jelena Diakonikolas

We prove that for every $D \in \N$, and large enough constant $d \in \N$, with high probability over the choice of $G \sim G(n,d/n)$, the \Erdos-\Renyi random graph distribution, the canonical degree $2D$ Sum-of-Squares relaxation fails to…

Data Structures and Algorithms · Computer Science 2024-06-27 Pravesh Kothari , Aaron Potechin , Jeff Xu

We propose a new yet natural algorithm for learning the graph structure of general discrete graphical models (a.k.a. Markov random fields) from samples. Our algorithm finds the neighborhood of a node by sequentially adding nodes that…

Machine Learning · Statistics 2012-02-09 Praneeth Netrapalli , Siddhartha Banerjee , Sujay Sanghavi , Sanjay Shakkottai

Sampling technique has become one of the recent research focuses in the graph-related fields. Most of the existing graph sampling algorithms tend to sample the high degree or low degree nodes in the complex networks because of the…

Social and Information Networks · Computer Science 2018-02-02 Junpeng Zhu , Hui Li , Mei Chen , Zhenyu Dai , Ming Zhu

We propose a locally differentially private graph clustering algorithm. Previous works have explored this problem, including approaches that apply spectral clustering to graphs generated via the randomized response algorithm. However, these…

Data Structures and Algorithms · Computer Science 2025-05-19 Vorapong Suppakitpaisarn , Sayan Mukherjee

In this paper, we consider efficient differentially private empirical risk minimization from the viewpoint of optimization algorithms. For strongly convex and smooth objectives, we prove that gradient descent with output perturbation not…

Machine Learning · Computer Science 2017-05-25 Jiaqi Zhang , Kai Zheng , Wenlong Mou , Liwei Wang

Graphon estimation has been one of the most fundamental problems in network analysis and has received considerable attention in the past decade. From the statistical perspective, the minimax error rate of graphon estimation has been…

Statistics Theory · Mathematics 2024-08-14 Yuetian Luo , Chao Gao

Graphical models use graphs to compactly capture stochastic dependencies amongst a collection of random variables. Inference over graphical models corresponds to finding marginal probability distributions given joint probability…

Machine Learning · Statistics 2013-04-02 Divyanshu Vats , José M. F. Moura

In this paper, we study the problem of summation evaluation of secrets. The secrets are distributed over a network of nodes that form a ring graph. Privacy-preserving iterative protocols for computing the sum of the secrets are proposed,…

Cryptography and Security · Computer Science 2020-04-15 Yang Liu , Qingchen Liu , Xiong Zhang , Shuqi Qin , Xiaoping Lei

We give the first polynomial time and sample $(\epsilon, \delta)$-differentially private (DP) algorithm to estimate the mean, covariance and higher moments in the presence of a constant fraction of adversarial outliers. Our algorithm…

Machine Learning · Statistics 2021-12-08 Pravesh K. Kothari , Pasin Manurangsi , Ameya Velingker

We present an algorithm to compute best least-squares approximations of discrete real-valued functions by first-degree splines (broken lines) with free knots. We demonstrate that the algorithm delivers after a finite number of steps a…

Numerical Analysis · Mathematics 2017-04-20 Ludwig J. Cromme , Jens Kunath , Andreas Krebs

Most algorithms for decentralized learning employ a consensus or diffusion mechanism to drive agents to a common solution of a global optimization problem. Generally this takes the form of linear averaging, at a rate of contraction…

Optimization and Control · Mathematics 2024-06-07 Aaron Fainman , Stefan Vlaski

In this paper we consider a family of algorithms for approximate implicitization of rational parametric curves and surfaces. The main approximation tool in all of the approaches is the singular value decomposition, and they are therefore…

Numerical Analysis · Mathematics 2016-05-30 Oliver J. D. Barrowclough , Tor Dokken

Lipschitz extensions were recently proposed as a tool for designing node differentially private algorithms. However, efficiently computable Lipschitz extensions were known only for 1-dimensional functions (that is, functions that output a…

Cryptography and Security · Computer Science 2015-04-30 Sofya Raskhodnikova , Adam Smith