English
Related papers

Related papers: Quantum Algorithms and Lower Bounds for Linear Reg…

200 papers

Many problems that can be solved in quadratic time have bit-parallel speed-ups with factor $w$, where $w$ is the computer word size. A classic example is computing the edit distance of two strings of length $n$, which can be solved in…

Quantum Physics · Physics 2023-04-17 Massimo Equi , Arianne Meijer - van de Griend , Veli Mäkinen

We show that solutions to the popular convex matrix LASSO problem (nuclear-norm--penalized linear least-squares) have low rank under similar assumptions as required by classical low-rank matrix sensing error bounds. Although the purpose of…

Optimization and Control · Mathematics 2026-04-16 Andrew D. McRae

This paper considers stochastic convex optimization problems with two sets of constraints: (a) deterministic constraints on the domain of the optimization variable, which are difficult to project onto; and (b) deterministic or stochastic…

Optimization and Control · Mathematics 2022-05-25 Zeeshan Akhtar , Ketan Rajawat

We consider the problem of approximating a function in general nonlinear subsets of $L^2$ when only a weighted Monte Carlo estimate of the $L^2$-norm can be computed. Of particular interest in this setting is the concept of sample…

Numerical Analysis · Mathematics 2021-08-12 Philipp Trunschke

The Lasserre Hierarchy is a set of semidefinite programs which yield increasingly tight bounds on optimal solutions to many NP-hard optimization problems. The hierarchy is parameterized by levels, with a higher level corresponding to a more…

Quantum Physics · Physics 2021-11-16 Ojas Parekh , Kevin Thompson

The most important computational problem on lattices is the Shortest Vector Problem (SVP). In this paper, we present new algorithms that improve the state-of-the-art for provable classical/quantum algorithms for SVP. We present the…

Data Structures and Algorithms · Computer Science 2025-08-19 Divesh Aggarwal , Yanlin Chen , Rajendra Kumar , Yixin Shen

A hybrid quantum-classical algorithm is a computational scheme in which quantum circuits are used to extract information that is then processed by a classical routine to guide subsequent quantum operations. These algorithms are especially…

Quantum Physics · Physics 2025-09-03 Alon Levi , Ziv Ossi , Eliahu Cohen , Amit Te'eni

The Frank-Wolfe method has become increasingly useful in statistical and machine learning applications, due to the structure-inducing properties of the iterates, and especially in settings where linear minimization over the feasible set is…

Machine Learning · Computer Science 2024-12-16 Zikai Xiong , Robert M. Freund

We give the first polynomial-time algorithm for performing linear or polynomial regression resilient to adversarial corruptions in both examples and labels. Given a sufficiently large (polynomial-size) training set drawn i.i.d. from…

Machine Learning · Computer Science 2020-06-05 Adam Klivans , Pravesh K. Kothari , Raghu Meka

We give a quantum speedup for solving the canonical semidefinite programming relaxation for binary quadratic optimization. This class of relaxations for combinatorial optimization has so far eluded quantum speedups. Our methods combine…

Data Structures and Algorithms · Computer Science 2022-01-26 Fernando G. S L. Brandão , Richard Kueng , Daniel Stilck França

Nonconvex penalty methods for sparse modeling in linear regression have been a topic of fervent interest in recent years. Herein, we study a family of nonconvex penalty functions that we call the trimmed Lasso and that offers exact control…

Methodology · Statistics 2017-08-16 Dimitris Bertsimas , Martin S. Copenhaver , Rahul Mazumder

Least absolute shrinkage and selection operator (Lasso), a popular method for high-dimensional regression, is now used widely for estimating high-dimensional time series models such as the vector autoregression (VAR). Selecting its tuning…

Methodology · Statistics 2025-12-16 Tathagata Sadhukhan , Ines Wilms , Stephan Smeekes , Sumanta Basu

Linear Regression is a seminal technique in statistics and machine learning, where the objective is to build linear predictive models between a response (i.e., dependent) variable and one or more predictor (i.e., independent) variables. In…

Computational Geometry · Computer Science 2023-07-19 Suraj Shetiya , Shohedul Hasan , Abolfazl Asudeh , Gautam Das

Recently, increased computational power and data availability, as well as algorithmic advances, have led machine learning techniques to impressive results in regression, classification, data-generation and reinforcement learning tasks.…

Quantum approximate optimization is one of the promising candidates for useful quantum computation, particularly in the context of finding approximate solutions to Quadratic Unconstrained Binary Optimization (QUBO) problems. However, the…

The Harrow-Hassidim-Lloyd (HHL) quantum algorithm for sampling from the solution of a linear system provides an exponential speed-up over its classical counterpart. The problem of solving a system of linear equations has a wide scope of…

Recent computational strategies based on screening tests have been proposed to accelerate algorithms addressing penalized sparse regression problems such as the Lasso. Such approaches build upon the idea that it is worth dedicating some…

Machine Learning · Statistics 2015-10-28 Antoine Bonnefoy , Valentin Emiya , Liva Ralaivola , Rémi Gribonval

Clustering is one of the most important tools for analysis of large datasets, and perhaps the most popular clustering algorithm is Lloyd's algorithm for $k$-means. This algorithm takes $n$ vectors $V=[v_1,\dots,v_n]\in\mathbb{R}^{d\times…

Quantum Physics · Physics 2025-07-18 Arjan Cornelissen , Joao F. Doriguello , Alessandro Luongo , Ewin Tang

The Lasso is a computationally efficient regression regularization procedure that can produce sparse estimators when the number of predictors (p) is large. Oracle inequalities provide probability loss bounds for the Lasso estimator at a…

Machine Learning · Statistics 2017-07-21 Cheryl J. Flynn , Clifford M. Hurvich , Jeffrey S. Simonoff

Quantum algorithms can deliver asymptotic speedups over their classical counterparts. However, there are few cases where a substantial quantum speedup has been worked out in detail for reasonably-sized problems, when compared with the best…

Quantum Physics · Physics 2019-07-24 Earl Campbell , Ankur Khurana , Ashley Montanaro