English
Related papers

Related papers: An $\tilde{O}(\frac{1}{\sqrt{T}})$-error online al…

200 papers

We develop a new reduction that converts any online convex optimization algorithm suffering $O(\sqrt{T})$ regret into an $\epsilon$-differentially private stochastic convex optimization algorithm with the optimal convergence rate $\tilde…

Machine Learning · Computer Science 2022-10-14 Qinzi Zhang , Hoang Tran , Ashok Cutkosky

We provide more sample-efficient versions of some basic routines in quantum data analysis, along with simpler proofs. Particularly, we give a quantum "Threshold Search" algorithm that requires only $O((\log^2 m)/\epsilon^2)$ samples of a…

Quantum Physics · Physics 2024-08-07 Costin Bădescu , Ryan O'Donnell

We propose an online debiased lasso (ODL) method for statistical inference in high-dimensional linear models with streaming data. The proposed ODL consists of an efficient computational algorithm for streaming data and approximately normal…

Statistics Theory · Mathematics 2021-08-20 Ruijian Han , Lan Luo , Yuanyuan Lin , Jian Huang

We present an efficient and elementary algorithm for computing the number of primes up to $N$ in $\tilde{O}(\sqrt N)$ time, improving upon the existing combinatorial methods that require $\tilde{O}(N ^ {2/3})$ time. Our method has a similar…

Number Theory · Mathematics 2023-08-15 Dean Hirsch , Ido Kessler , Uri Mendlovic

Large tensor learning algorithms are typically computationally expensive and require storing a vast amount of data. In this paper, we propose a unified online Riemannian gradient descent (oRGrad) algorithm for tensor learning, which is…

Machine Learning · Statistics 2024-10-23 Jingyang Li , Jian-Feng Cai , Yang Chen , Dong Xia

Optimizing smooth convex functions in stochastic settings, where only noisy estimates of gradients and Hessians are available, is a fundamental problem in optimization. While first-order methods possess a low per-iteration cost, their…

Statistics Theory · Mathematics 2026-02-06 Antoine Godichon-Baggioni , Bruno Portier , Guillaume Sallé

We formalize the problem of machine unlearning as design of efficient unlearning algorithms corresponding to learning algorithms which perform a selection of adaptive queries from structured query classes. We give efficient unlearning…

Machine Learning · Computer Science 2023-07-24 Enayat Ullah , Raman Arora

Given $\kappa$ databases of unstructured entries, we propose a quantum algorithm to find the common entries between those databases. The proposed algorithm requires $\mathcal{O}(\kappa \sqrt{N})$ queries to find the common entries, where…

Quantum Physics · Physics 2019-02-19 Khaled El-Wazan

We present an O(\sqrt{N}) discrete query quantum algorithm for evaluating balanced binary NAND formulas and an O(N^{{1/2}+O(\frac{1}{\sqrt{\log N}})}) discrete query quantum algorithm for evaluating arbitrary binary NAND formulas.

Quantum Physics · Physics 2007-05-23 Andris Ambainis

In the stochastic online vector balancing problem, vectors $v_1,v_2,\ldots,v_T$ chosen independently from an arbitrary distribution in $\mathbb{R}^n$ arrive one-by-one and must be immediately given a $\pm$ sign. The goal is to keep the norm…

Data Structures and Algorithms · Computer Science 2020-07-22 Nikhil Bansal , Haotian Jiang , Raghu Meka , Sahil Singla , Makrand Sinha

In the online sorting problem, $n$ items are revealed one by one and have to be placed (immediately and irrevocably) into empty cells of a size-$n$ array. The goal is to minimize the sum of absolute differences between items in consecutive…

Data Structures and Algorithms · Computer Science 2024-06-28 Mikkel Abrahamsen , Ioana O. Bercea , Lorenzo Beretta , Jonas Klausen , László Kozma

We provide faster randomized algorithms for computing an $\epsilon$-optimal policy in a discounted Markov decision process with $A_{\text{tot}}$-state-action pairs, bounded rewards, and discount factor $\gamma$. We provide an…

Machine Learning · Computer Science 2024-05-22 Yujia Jin , Ishani Karmarkar , Aaron Sidford , Jiayi Wang

We consider unreliable distributed learning systems wherein the training data is kept confidential by external workers, and the learner has to interact closely with those workers to train a model. In particular, we assume that there exists…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-10 Lili Su , Jiaming Xu

In the online metric matching problem, $n$ servers and $n$ requests lie in a metric space. Servers are available upfront, and requests arrive sequentially. An arriving request must be matched immediately and irrevocably to an available…

Data Structures and Algorithms · Computer Science 2026-04-22 Yingxi Li , Ellen Vitercik , Mingwei Yang

We show how to determine whether a given pattern p of length m occurs in a given text t of length n in ${\tilde O}(\sqrt{n}+\sqrt{m})$\footnote{${\tilde O}$ allows for logarithmic factors in m and $n/m$} time, with inverse polynomial…

Quantum Physics · Physics 2007-05-23 H. Ramesh , V. Vinay

Graph reconstruction can efficiently detect the underlying topology of massive networks such as the Internet. Given a query oracle and a set of nodes, the goal is to obtain the edge set by performing as few queries as possible. An algorithm…

Data Structures and Algorithms · Computer Science 2024-07-29 Clara Stegehuis , Lotte Weedage

Grover's algorithm accelerates unstructured database search quadratically compared to classical algorithms. In the NISQ era, distributed quantum computing can decrease circuit depth and reduce noise. In this paper, an algorithm for…

Quantum Physics · Physics 2026-04-16 Huaijing Huang , Daowen Qiu , Ximing Hua , Xinyu Chen

Online linear programming plays an important role in both revenue management and resource allocation, and recent research has focused on developing efficient first-order online learning algorithms. Despite the empirical success of…

Machine Learning · Computer Science 2025-01-08 Wenzhi Gao , Chunlin Sun , Chenyu Xue , Dongdong Ge , Yinyu Ye

We study Online Convex Optimization (OCO) with adversarial constraints, where an online algorithm must make sequential decisions to minimize both convex loss functions and cumulative constraint violations. We focus on a setting where the…

Machine Learning · Statistics 2025-03-14 Jordan Lekeufack , Michael I. Jordan

Background. Commonly, Deep Neural Networks (DNNs) generalize well on samples drawn from a distribution similar to that of the training set. However, DNNs' predictions are brittle and unreliable when the test samples are drawn from a…

Machine Learning · Computer Science 2022-04-01 Matan Haroush , Tzviel Frostig , Ruth Heller , Daniel Soudry