English
Related papers

Related papers: Computational Lower Bounds for Graphon Estimation …

200 papers

We consider N-fold 4-block decomposable integer programs, which simultaneously generalize N-fold integer programs and two-stage stochastic integer programs with N scenarios. In previous work [R. Hemmecke, M. Koeppe, R. Weismantel, A…

Optimization and Control · Mathematics 2017-01-03 Raymond Hemmecke , Matthias Köppe , Robert Weismantel

Many applications, including rank aggregation, crowd-labeling, and graphon estimation, can be modeled in terms of a bivariate isotonic matrix with unknown permutations acting on its rows and/or columns. We consider the problem of estimating…

Machine Learning · Statistics 2019-10-29 Cheng Mao , Ashwin Pananjady , Martin J. Wainwright

To date, no "information-theoretic" frameworks for reasoning about generalization error have been shown to establish minimax rates for gradient descent in the setting of stochastic convex optimization. In this work, we consider the prospect…

Reinforcement learning with function approximation has recently achieved tremendous results in applications with large state spaces. This empirical success has motivated a growing body of theoretical work proposing necessary and sufficient…

Machine Learning · Computer Science 2022-07-05 Daniel Kane , Sihan Liu , Shachar Lovett , Gaurav Mahajan

Fine-grained complexity theory is the area of theoretical computer science that proves conditional lower bounds based on the Strong Exponential Time Hypothesis and similar conjectures. This area has been thriving in the last decade, leading…

Computational Geometry · Computer Science 2021-10-22 Karl Bringmann

We study the problem of learning communities in the presence of modeling errors and give robust recovery algorithms for the Stochastic Block Model (SBM). This model, which is also known as the Planted Partition Model, is widely used for…

Data Structures and Algorithms · Computer Science 2016-06-27 Konstantin Makarychev , Yury Makarychev , Aravindan Vijayaraghavan

A scheme for locally adaptive bandwidth selection is proposed which sensitively shrinks the bandwidth of a kernel estimator at lowest density regions such as the support boundary which are unknown to the statistician. In case of a…

Statistics Theory · Mathematics 2016-01-25 Tim Patschkowski , Angelika Rohde

Recently graph neural network (GNN) based algorithms were proposed to solve a variety of combinatorial optimization problems, including Maximum Cut problem, Maximum Independent Set problem and similar other…

Machine Learning · Computer Science 2023-06-06 David Gamarnik

The minimum conductance problem is an NP-hard graph partitioning problem. Apart from the search for bottlenecks in complex networks, the problem is very closely related to the popular area of network community detection. In this paper, we…

Social and Information Networks · Computer Science 2017-04-11 David Chalupa

Most recent developments on the stochastic block model (SBM) rely on the knowledge of the model parameters, or at least on the number of communities. This paper introduces efficient algorithms that do not require such knowledge and yet…

Probability · Mathematics 2015-06-12 Emmanuel Abbe , Colin Sandon

For many applications in signal processing and machine learning, we are tasked with minimizing a large sum of convex functions subject to a large number of convex constraints. In this paper, we devise a new random projection method (RPM) to…

Optimization and Control · Mathematics 2024-04-08 Zhichun Yang , Fu-quan Xia , Kai Tu , Man-Chung Yue

This article derives lower bounds on the convergence rate of continuous-time gradient-based optimization algorithms. The algorithms are subjected to a time-normalization constraint that avoids a reparametrization of time in order to make…

Optimization and Control · Mathematics 2020-08-04 Michael Muehlebach , Michael I. Jordan

Bilevel optimization problems are receiving increasing attention in machine learning as they provide a natural framework for hyperparameter optimization and meta-learning. A key step to tackle these problems is the efficient computation of…

Machine Learning · Statistics 2025-05-20 Riccardo Grazzi , Massimiliano Pontil , Saverio Salzo

We study the problem of learning a low-degree spherical polynomial of degree $k_0 = \Theta(1) \ge 1$ defined on the unit sphere in $\RR^d$ by training an over-parameterized two-layer neural network with augmented feature in this paper. Our…

Machine Learning · Statistics 2026-03-24 Yingzhen Yang , Ping Li

Stochastic blockmodels (SBM) and their variants, $e.g.$, mixed-membership and overlapping stochastic blockmodels, are latent variable based generative models for graphs. They have proven to be successful for various tasks, such as…

Machine Learning · Computer Science 2019-05-15 Nikhil Mehta , Lawrence Carin , Piyush Rai

We propose a gradient-based method for quadratic programming problems with a single linear constraint and bounds on the variables. Inspired by the GPCG algorithm for bound-constrained convex quadratic programming [J.J. Mor\'e and G.…

Optimization and Control · Mathematics 2019-02-19 Daniela di Serafino , Gerardo Toraldo , Marco Viola , Jesse Barlow

The problem of detecting communities in a graph is maybe one the most studied inference problems, given its simplicity and widespread diffusion among several disciplines. A very common benchmark for this problem is the stochastic block…

Machine Learning · Statistics 2016-04-08 Adel Javanmard , Andrea Montanari , Federico Ricci-Tersenghi

Modern large-scale statistical models require to estimate thousands to millions of parameters. This is often accomplished by iterative algorithms such as gradient descent, projected gradient descent or their accelerated versions. What are…

Machine Learning · Statistics 2020-03-04 Michael Celentano , Andrea Montanari , Yuchen Wu

Motivated by the increasing need to understand the distributed algorithmic foundations of large-scale graph computations, we study some fundamental graph problems in a message-passing model for distributed computing where $k \geq 2$…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-27 Gopal Pandurangan , Peter Robinson , Michele Scquizzato

We consider maximization of stochastic monotone continuous submodular functions (CSF) with a diminishing return property. Existing algorithms only guarantee the performance \textit{in expectation}, and do not bound the probability of…

Data Structures and Algorithms · Computer Science 2023-03-22 Evan Becker , Jingdong Gao , Ted Zadouri , Baharan Mirzasoleiman