English
Related papers

Related papers: Beating the random assignment on constraint satisf…

200 papers

We consider the problem of spherical Gaussian Mixture models with $k \geq 3$ components when the components are well separated. A fundamental previous result established that separation of $\Omega(\sqrt{\log k})$ is necessary and sufficient…

Machine Learning · Computer Science 2020-06-22 Jeongyeol Kwon , Constantine Caramanis

The model of Dynamic Meta-Constraints has special activity constraints which can activate other constraints. It also has meta-constraints which range over other constraints. An algorithm is presented in which constraints can be assigned one…

Programming Languages · Computer Science 2007-05-23 Janet van der Linden

We prove a \emph{query complexity} lower bound on rank-one principal component analysis (PCA). We consider an oracle model where, given a symmetric matrix $M \in \mathbb{R}^{d \times d}$, an algorithm is allowed to make $T$ \emph{exact}…

Machine Learning · Computer Science 2017-04-18 Max Simchowitz , Ahmed El Alaoui , Benjamin Recht

We present and analyze a wait-free deterministic algorithm for solving the at-most-once problem: how m shared-memory fail-prone processes perform asynchronously n jobs at most once. Our algorithmic strategy provides for the first time…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-12-04 Sotirios Kentros , Aggelos Kiayias

Mixed-integer optimisation problems can be computationally challenging. Here, we introduce and analyse two efficient algorithms with a specific sequential design that are aimed at dealing with sampled problems within this class. At each…

Optimization and Control · Mathematics 2023-03-07 Mohammadreza Chamanbaz , Roland Bouffanais

We give an algorithm to compute a one-dimensional shape-constrained function that best fits given data in weighted-$L_{\infty}$ norm. We give a single algorithm that works for a variety of commonly studied shape constraints including…

Data Structures and Algorithms · Computer Science 2019-05-30 David Durfee , Yu Gao , Anup B. Rao , Sebastian Wild

We consider high dimensional random optimization problems where the dynamical variables are subjected to non-convex excluded volume constraints. We focus on the case in which the cost function is a simple quadratic cost and the excluded…

Disordered Systems and Neural Networks · Physics 2022-03-14 Antonio Sclocchi , Pierfrancesco Urbani

Stochastic convex optimization is one of the most well-studied models for learning in modern machine learning. Nevertheless, a central fundamental question in this setup remained unresolved: "How many data points must be observed so that…

Machine Learning · Computer Science 2023-11-10 Daniel Carmon , Roi Livni , Amir Yehudayoff

We establish a lower bound of $\Omega{(\sqrt{n})}$ on the bounded-error quantum query complexity of read-once Boolean functions, providing evidence for the conjecture that $\Omega(\sqrt{D(f)})$ is a lower bound for all Boolean functions.…

Quantum Physics · Physics 2007-05-23 Howard Barnum , Michael Saks

In the last two decades the study of random instances of constraint satisfaction problems (CSPs) has flourished across several disciplines, including computer science, mathematics and physics. The diversity of the developed methods, on the…

Combinatorics · Mathematics 2025-07-02 Konstantinos Panagiotou , Matija Pasch

We provide tight upper and lower bounds on the complexity of minimizing the average of $m$ convex functions using gradient and prox oracles of the component functions. We show a significant gap between the complexity of deterministic vs…

Optimization and Control · Mathematics 2019-04-05 Blake Woodworth , Nathan Srebro

This paper considers the problem of minimizing an expectation function over a closed convex set, coupled with a {\color{black} functional or expectation} constraint on either decision variables or problem parameters. We first present a new…

Optimization and Control · Mathematics 2020-10-05 Guanghui Lan , Zhiqiang Zhou

We present a quantum algorithm that has rigorous runtime guarantees for several families of binary optimization problems, including Quadratic Unconstrained Binary Optimization (QUBO), Ising spin glasses ($p$-spin model), and $k$-local…

This paper develops a framework for the design of scoring rules to optimally incentivize an agent to exert a multi-dimensional effort. This framework is a generalization to strategic agents of the classical knapsack problem (cf. Briest,…

Computer Science and Game Theory · Computer Science 2023-07-03 Jason D. Hartline , Liren Shan , Yingkai Li , Yifan Wu

We are interested in solving convex optimization problems with large numbers of constraints. Randomized algorithms, such as random constraint sampling, have been very successful in giving nearly optimal solutions to such problems. In this…

Optimization and Control · Mathematics 2016-11-29 William B. Haskell , Yu Pengqian

We study the binary perceptron, a random constraint satisfaction problem that asks to find a Boolean vector in the intersection of independently chosen random halfspaces. A striking feature of this model is that at every positive constraint…

Computational Complexity · Computer Science 2026-04-02 Shuyang Gong , Brice Huang , Shuangping Li , Mark Sellke

We initiate the study of algorithms for constraint satisfaction problems with ML oracle advice. We introduce two models of advice and then design approximation algorithms for Max Cut, Max $2$-Lin, and Max $3$-Lin in these models. In…

Data Structures and Algorithms · Computer Science 2024-07-31 Suprovat Ghoshal , Konstantin Makarychev , Yury Makarychev

Many combinatorial optimization problems can be phrased in the language of constraint satisfaction problems. We introduce a graph neural network architecture for solving such optimization problems. The architecture is generic; it works for…

Artificial Intelligence · Computer Science 2020-02-12 Jan Toenshoff , Martin Ritzert , Hinrikus Wolf , Martin Grohe

In this paper, we consider elliptic boundary value problems with discontinuous coefficients and obtain the asymptotic optimal error estimate $\|u-u_k\|_{1,\Omega}\leqslant Ch|\ln h|^{1/2}\|u\|_{2,\Omega_1+\Omega_2}$ for triangle linear…

Numerical Analysis · Mathematics 2013-11-19 Jinchao Xu

In most machine learning applications, classification accuracy is not the primary metric of interest. Binary classifiers which face class imbalance are often evaluated by the $F_\beta$ score, area under the precision-recall curve, Precision…

Machine Learning · Computer Science 2018-03-02 Alan Mackey , Xiyang Luo , Elad Eban