English
Related papers

Related papers: List-Decodable Mean Estimation in Nearly-PCA Time

200 papers

We consider the Partition problem and propose a deterministic FPTAS (Fully Polynomial-Time Approximation Scheme) that runs in $\widetilde{O}(n + 1/\varepsilon)$-time. This is the best possible (up to a polylogarithmic factor) assuming the…

Data Structures and Algorithms · Computer Science 2025-01-23 Lin Chen , Jiayi Lian , Yuchen Mao , Guochuan Zhang

In the Wishart model for sparse PCA we are given $n$ samples $Y_1,\ldots, Y_n$ drawn independently from a $d$-dimensional Gaussian distribution $N({0, Id + \beta vv^\top})$, where $\beta > 0$ and $v\in \mathbb{R}^d$ is a $k$-sparse unit…

Machine Learning · Computer Science 2023-11-10 Gleb Novikov

A prominent problem in scheduling theory is the weighted flow time problem on one machine. We are given a machine and a set of jobs, each of them characterized by a processing time, a release time, and a weight. The goal is to find a…

Data Structures and Algorithms · Computer Science 2023-08-14 Alexander Armbruster , Lars Rohwedder , Andreas Wiese

While most theoretical run time analyses of discrete randomized search heuristics provide bounds on the expected number of evaluations to find the global optimum, we consider the anytime performance of evolutionary and…

Neural and Evolutionary Computing · Computer Science 2026-04-09 Timo Kötzing , Jurek Sander

In the current work we introduce a novel estimation of distribution algorithm to tackle a hard combinatorial optimization problem, namely the single-machine scheduling problem, with uncertain delivery times. The majority of the existing…

Data Structures and Algorithms · Computer Science 2013-12-05 Boris Mitavskiy , Jun He

We consider the problem of estimating how well a model class is capable of fitting a distribution of labeled data. We show that it is often possible to accurately estimate this "learnability" even when given an amount of data that is too…

Machine Learning · Computer Science 2019-03-26 Weihao Kong , Gregory Valiant

We develop two methods for the following fundamental statistical task: given an $\epsilon$-corrupted set of $n$ samples from a $d$-dimensional sub-Gaussian distribution, return an approximate top eigenvector of the covariance matrix. Our…

Data Structures and Algorithms · Computer Science 2020-06-15 Arun Jambulapati , Jerry Li , Kevin Tian

We study parameter inference in simulation-based stochastic models where the analytical form of the likelihood is unknown. The main difficulty is that score evaluation as a ratio of noisy Monte Carlo estimators induces bias and instability,…

Machine Learning · Statistics 2025-10-31 Zehao Li , Zhouchen Lin , Yijie Peng

This paper concerns quasi-stochastic approximation (QSA) to solve root finding problems commonly found in applications to optimization and reinforcement learning. The general constant gain algorithm may be expressed as the…

Optimization and Control · Mathematics 2024-04-02 Caio Kalil Lauand , Sean Meyn

Multi-task learning (MTL) has emerged as a pivotal paradigm in machine learning by leveraging shared structures across multiple related tasks. Despite its empirical success, the development of likelihood-based efficiently solvable…

Machine Learning · Computer Science 2026-05-07 Shihong Ding , Fangyu Du , Cong Fang

We present a framework for analyzing the exact dynamics of a class of online learning algorithms in the high-dimensional scaling limit. Our results are applied to two concrete examples: online regularized linear regression and principal…

Machine Learning · Computer Science 2017-12-13 Chuang Wang , Jonathan Mattingly , Yue M. Lu

We obtain robust and computationally efficient estimators for learning several linear models that achieve statistically optimal convergence rate under minimal distributional assumptions. Concretely, we assume our data is drawn from a…

Machine Learning · Statistics 2020-12-07 Ainesh Bakshi , Adarsh Prasad

We study stochastic programs where the decision-maker cannot observe the distribution of the exogenous uncertainties but has access to a finite set of independent samples from this distribution. In this setting, the goal is to find a…

Optimization and Control · Mathematics 2019-12-24 Bart P. G. Van Parys , Peyman Mohajerin Esfahani , Daniel Kuhn

The Median of Medians (also known as BFPRT) algorithm, although a landmark theoretical achievement, is seldom used in practice because it and its variants are slower than simple approaches based on sampling. The main contribution of this…

Data Structures and Algorithms · Computer Science 2016-08-05 Andrei Alexandrescu

In this work, we study the $k$-median and $k$-means clustering problems when the data is distributed across many servers and can contain outliers. While there has been a lot of work on these problems for worst-case instances, we focus on…

Data Structures and Algorithms · Computer Science 2019-03-08 Pranjal Awasthi , Ainesh Bakshi , Maria-Florina Balcan , Colin White , David Woodruff

Minimum-weight cut (min-cut) is a basic measure of a network's connectivity strength. While the min-cut can be computed efficiently in the sequential setting [Karger STOC'96], there was no efficient way for a distributed network to compute…

Data Structures and Algorithms · Computer Science 2020-11-17 Michal Dory , Yuval Efron , Sagnik Mukhopadhyay , Danupon Nanongkai

In this paper, we study the problem of mean estimation under 1-bit communication constraints. We propose a novel adaptive mean estimator based solely on randomized threshold queries, where each 1-bit outcome indicates whether a given sample…

Machine Learning · Statistics 2026-05-25 Ivan Lau , Jonathan Scarlett

In the $k$-cut problem, we are given an edge-weighted graph $G$ and an integer $k$, and have to remove a set of edges with minimum total weight so that $G$ has at least $k$ connected components. The current best algorithms are an…

Data Structures and Algorithms · Computer Science 2019-03-22 Anupam Gupta , Euiwoong Lee , Jason Li

This paper demonstrates the usefulness of distributed local verification of proofs, as a tool for the design of self-stabilizing algorithms.In particular, it introduces a somewhat generalized notion of distributed local proofs, and utilizes…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-12-25 Amos Korman , Shay Kutten , Toshimitsu Masuzawa

One of the most fundamental problems in Computer Science is the Knapsack problem. Given a set of n items with different weights and values, it asks to pick the most valuable subset whose total weight is below a capacity threshold T. Despite…

Data Structures and Algorithms · Computer Science 2018-07-16 Kyriakos Axiotis , Christos Tzamos