English
Related papers

Related papers: Beating the random assignment on constraint satisf…

200 papers

We analyze the adaptive first order algorithm AMSGrad, for solving a constrained stochastic optimization problem with a weakly convex objective. We prove the $\mathcal{\tilde O}(t^{-1/4})$ rate of convergence for the norm of the gradient of…

Machine Learning · Statistics 2020-06-12 Ahmet Alacaoglu , Yura Malitsky , Volkan Cevher

For a given domain $\Omega \subset \Bbb{R}^n$, we consider the variational problem of minimizing the $L^1$-norm of the gradient on $\Omega$ of a function $u$ with prescribed continuous boundary values and satisfying a continuous lower…

Analysis of PDEs · Mathematics 2007-05-23 William P. Ziemer , Kevin Zumbrun

We compute the integral of a function or the expectation of a random variable with minimal cost and use, for our new algorithm and for upper bounds of the complexity, i.i.d. samples. Under certain assumptions it is possible to select a…

Numerical Analysis · Mathematics 2018-10-24 Robert J. Kunsch , Erich Novak , Daniel Rudolf

It is known that the dual of the general adversary bound can be used to build quantum query algorithms with optimal complexity. Despite this result, not many quantum algorithms have been designed this way. This paper shows another example…

Quantum Physics · Physics 2011-08-16 Aleksandrs Belovs , Troy Lee

An algorithm is proposed for solving optimization problems with stochastic objective and deterministic equality and inequality constraints. This algorithm is objective-function-free in the sense that it only uses the objective's gradient…

Optimization and Control · Mathematics 2026-04-01 S. Gratton , Ph. L. Toint

We present an end-to-end framework for the Assignment Problem with multiple tasks mapped to a group of workers, using reinforcement learning while preserving many constraints. Tasks and workers have time constraints and there is a cost…

Artificial Intelligence · Computer Science 2021-06-08 Sharmin Pathan , Vyom Shrivastava

We propose a deep learning approach to the obstacle problem inspired by the first-order system least-squares (FOSLS) framework. This method reformulates the problem as a convex minimization task; by simultaneously approximating the…

Numerical Analysis · Mathematics 2025-08-28 Gabriel Acosta , Eugenia Belén , Francisco M. Bersetche , Juan Pablo Borthagaray

In the \textsc{Maximum Degree Contraction} problem, input is a graph $G$ on $n$ vertices, and integers $k, d$, and the objective is to check whether $G$ can be transformed into a graph of maximum degree at most $d$, using at most $k$ edge…

Data Structures and Algorithms · Computer Science 2020-09-25 Saket Saurabh , Prafullkumar Tale

We propose a novel constrained reinforcement learning method for finding optimal policies in Markov Decision Processes while satisfying temporal logic constraints with a desired probability throughout the learning process. An…

Robotics · Computer Science 2021-09-07 Derya Aksaray , Yasin Yazicioglu , Ahmet Semi Asarkaya

In stochastic zeroth-order optimization, a problem of practical relevance is understanding how to fully exploit the local geometry of the underlying objective function. We consider a fundamental setting in which the objective function is…

Machine Learning · Computer Science 2023-12-27 Qian Yu , Yining Wang , Baihe Huang , Qi Lei , Jason D. Lee

This paper introduces the Simultaneous assignment problem. Let us given a graph with a weight and a capacity function on its edges, and a set of its subgraphs along with a degree upper bound function for each of them. We are also given a…

Data Structures and Algorithms · Computer Science 2023-01-24 Péter Madarasi

We propose a novel adaptive, accelerated algorithm for the stochastic constrained convex optimization setting. Our method, which is inspired by the Mirror-Prox method, \emph{simultaneously} achieves the optimal rates for smooth/non-smooth…

Optimization and Control · Mathematics 2019-10-31 Ali Kavis , Kfir Y. Levy , Francis Bach , Volkan Cevher

Many popular learning algorithms (E.g. Regression, Fourier-Transform based algorithms, Kernel SVM and Kernel ridge regression) operate by reducing the problem to a convex optimization problem over a vector space of functions. These methods…

Machine Learning · Computer Science 2014-05-13 Amit Daniely , Nati Linial , Shai Shalev-Shwartz

We show that Durr-Hoyer's quantum algorithm of searching for extreme point of integer function can not be sped up for functions chosen randomly. Any other algorithm acting in substantially shorter time $o(\sqrt{2^n})$ gives incorrect answer…

Quantum Physics · Physics 2009-10-31 Yuri Ozhigov

In this paper, we focus on the problem of stochastic optimization where the objective function can be written as an expectation function over a closed convex set. We also consider multiple expectation constraints which restrict the domain…

Statistics Theory · Mathematics 2019-06-18 Kinjal Basu , Preetam Nandy

We study the performances of stochastic heuristic search algorithms on Uniquely Extendible Constraint Satisfaction Problems with random inputs. We show that, for any heuristic preserving the Poissonian nature of the underlying instance, the…

Computational Complexity · Computer Science 2009-11-13 Fabrizio Altarelli , Remi Monasson , Francesco Zamponi

The ability of the Quantum Approximate Optimization Algorithm (QAOA) to deliver a quantum advantage on combinatorial optimization problems is still unclear. Recently, a scaling advantage over a classical solver was postulated to exist for…

Quantum Physics · Physics 2024-12-02 Thorge Müller , Ajainderpal Singh , Frank K. Wilhelm , Tim Bode

We exploit analogies between first-order algorithms for constrained optimization and non-smooth dynamical systems to design a new class of accelerated first-order algorithms for constrained optimization. Unlike Frank-Wolfe or projected…

Optimization and Control · Mathematics 2025-05-02 Michael Muehlebach , Michael I. Jordan

We study the sample complexity of differentially private optimization of quasi-concave functions. For a fixed input domain $\mathcal{X}$, Cohen et al. (STOC 2023) proved that any generic private optimizer for low sensitive quasi-concave…

Cryptography and Security · Computer Science 2025-04-29 Kobbi Nissim , Eliad Tsfadia , Chao Yan

In this paper, we study the problem of learning multi-dimensional Gaussian Mixture Models (GMMs), with a specific focus on model order selection and efficient mixing distribution estimation. We first establish an information-theoretic lower…

Machine Learning · Statistics 2026-03-23 Xinyu Liu , Hai Zhang