English
Related papers

Related papers: Optimal SQ Lower Bounds for Learning Halfspaces wi…

200 papers

We design an efficient data structure for computing a suitably defined approximate depth of any query point in the arrangement $\mathcal{A}(S)$ of a collection $S$ of $n$ halfplanes or triangles in the plane or of halfspaces or simplices in…

Computational Geometry · Computer Science 2020-06-23 Dror Aiger , Haim Kaplan , Micha Sharir

Many machine learning and optimization algorithms are built upon the framework of stochastic approximation (SA), for which the selection of step-size (or learning rate) $\{\alpha_n\}$ is crucial for success. An essential condition for…

Statistics Theory · Mathematics 2025-08-05 Caio Kalil Lauand , Sean Meyn

The continuous improvements on image compression with variational autoencoders have lead to learned codecs competitive with conventional approaches in terms of rate-distortion efficiency. Nonetheless, taking the quantization into account…

Machine Learning · Computer Science 2025-06-11 Florian Borzechowski , Michael Schäfer , Heiko Schwarz , Jonathan Pfaff , Detlev Marpe , Thomas Wiegand

This paper is concerned with learning binary classifiers under adversarial label-noise. We introduce the problem of error-correction in learning where the goal is to recover the original clean data from a label-manipulated version of it,…

Machine Learning · Computer Science 2013-01-11 Srivatsan Laxman , Sushil Mittal , Ramarathnam Venkatesan

We study the problem of computationally efficient proper agnostic learning of multidimensional concept classes under the Gaussian distribution. In this setting, given i.i.d. labeled samples from an unknown distribution over $\mathbb{R}^d…

Data Structures and Algorithms · Computer Science 2026-05-28 Sergei Tikhonov , Arsen Vasilyan

We give an algorithm for PAC learning intersections of $k$ halfspaces with a $\rho$ margin to within error $\varepsilon$ that runs in time $\textsf{poly}(k, \varepsilon^{-1}, \rho^{-1}) \cdot \exp \left(O(\sqrt{n \log(1/\rho) \log…

Data Structures and Algorithms · Computer Science 2026-04-17 Shyamal Patel , Santosh Vempala

Learning with noisy labels (LNL) poses a significant challenge in training a well-generalized model while avoiding overfitting to corrupted labels. Recent advances have achieved impressive performance by identifying clean labels and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Wanxing Chang , Ye Shi , Jingya Wang

We consider estimation models of the form $Y=X^*+N$, where $X^*$ is some $m$-dimensional signal we wish to recover, and $N$ is symmetrically distributed noise that may be unbounded in all but a small $\alpha$ fraction of the entries. We…

Machine Learning · Computer Science 2022-11-15 Tommaso d'Orsi , Rajai Nasser , Gleb Novikov , David Steurer

Due to the over-emphasize of the quantity of data, the data quality has often been overlooked. However, not all training data points contribute equally to learning. In particular, if mislabeled, it might actively damage the performance of…

Machine Learning · Computer Science 2021-09-13 Vaibhav Pulastya , Gaurav Nuti , Yash Kumar Atri , Tanmoy Chakraborty

In the search with wildcards problem [Ambainis, Montanaro, Quantum Inf.~Comput.'14], one's goal is to learn an unknown bit-string $x \in \{-1,1\}^n$. An algorithm may, at unit cost, test equality of any subset of the hidden string with a…

Quantum Physics · Physics 2025-11-07 Arjan Cornelissen , Nikhil S. Mande , Subhasree Patro , Nithish Raja , Swagato Sanyal

Stochastic optimization is a widely used approach for optimization under uncertainty, where uncertain input parameters are modeled by random variables. Exact or approximation algorithms have been obtained for several fundamental problems in…

Machine Learning · Computer Science 2025-08-14 Arpit Agarwal , Rohan Ghuge , Viswanath Nagarajan , Zhengjia Zhuo

Subspace-based signal processing techniques, such as the Estimation of Signal Parameters via Rotational Invariant Techniques (ESPRIT) algorithm, are popular methods for spectral estimation. These algorithms can achieve the so-called…

Information Theory · Computer Science 2024-10-29 Zhiyan Ding , Ethan N. Epperly , Lin Lin , Ruizhe Zhang

We consider the question of learning $Q$-function in a sample efficient manner for reinforcement learning with continuous state and action spaces under a generative model. If $Q$-function is Lipschitz continuous, then the minimal sample…

Machine Learning · Computer Science 2020-06-12 Devavrat Shah , Dogyoon Song , Zhi Xu , Yuzhe Yang

We propose a sequential quadratic programming (SQP) algorithm for inequality constrained optimization that is robust to the presence of bounded noise in function and derivative evaluations. We cover the case where constraint evaluations…

Optimization and Control · Mathematics 2026-04-17 Figen Oztoprak , Richard Byrd

To overcome the limitations of classical partially connected Boltzmann machines and mainstream quantum Boltzmann machines (QBMs), this work extends the conventional circuit of the quantum approximate optimization algorithm (QAOA) to a…

Quantum Physics · Physics 2026-05-13 Jun Liu

We consider the following problem: estimate the size of a nonempty set $S\subseteq\left[ N\right] $, given both quantum queries to a membership oracle for $S$, and a device that generates equal superpositions $\left\vert S\right\rangle $…

Quantum Physics · Physics 2018-08-08 Scott Aaronson

Understanding the noise affecting a quantum device is of fundamental importance for scaling quantum technologies. A particularly important class of noise models is that of Pauli channels, as randomized compiling techniques can effectively…

Quantum Physics · Physics 2025-05-19 Omar Fawzi , Aadil Oufkir , Daniel Stilck França

We study the problem of learning general (i.e., not necessarily homogeneous) halfspaces under the Gaussian distribution on $R^d$ in the presence of some form of query access. In the classical pool-based active learning model, where the…

Machine Learning · Computer Science 2025-01-03 Ilias Diakonikolas , Daniel M. Kane , Mingchen Ma

Quantization has become a predominant approach for model compression, enabling deployment of large models trained on GPUs onto smaller form-factor devices for inference. Quantization-aware training (QAT) optimizes model parameters with…

Machine Learning · Computer Science 2022-12-13 Zheng Wang , Juncheng B Li , Shuhui Qu , Florian Metze , Emma Strubell

Q-learning, which seeks to learn the optimal Q-function of a Markov decision process (MDP) in a model-free fashion, lies at the heart of reinforcement learning. When it comes to the synchronous setting (such that independent samples for all…

Machine Learning · Statistics 2025-03-18 Gen Li , Changxiao Cai , Yuxin Chen , Yuting Wei , Yuejie Chi