English
Related papers

Related papers: One-pass additive-error subset selection for $\ell…

200 papers

We discuss a strategy of sparse approximation that is based on the use of an overcomplete basis, and evaluate its performance when a random matrix is used as this basis. A small combination of basis vectors is chosen from a given…

Information Theory · Computer Science 2016-06-29 Yoshinori Nakanishi-Ohno , Tomoyuki Obuchi , Masato Okada , Yoshiyuki Kabashima

Let $(Y,X_1,...,X_m)$ be a random vector. It is desired to predict $Y$ based on $(X_1,...,X_m)$. Examples of prediction methods are regression, classification using logistic regression or separating hyperplanes, and so on. We consider the…

Statistics Theory · Mathematics 2007-06-13 Eitan Greenshtein

Subset selection from massive data with noised information is increasingly popular for various applications. This problem is still highly challenging as current methods are generally slow in speed and sensitive to outliers. To address the…

Machine Learning · Computer Science 2014-11-18 Feiyun Zhu , Bin Fan , Xinliang Zhu , Ying Wang , Shiming Xiang , Chunhong Pan

In the $\ell_p$-subspace sketch problem, we are given an $n\times d$ matrix $A$ with $n>d$, and asked to build a small memory data structure $Q(A,\epsilon)$ so that, for any query vector $x\in\mathbb{R}^d$, we can output a number in…

Data Structures and Algorithms · Computer Science 2024-02-19 Yi Li , Honghao Lin , David P. Woodruff

LP-type problems such as the Minimum Enclosing Ball (MEB), Linear Support Vector Machine (SVM), Linear Programming (LP), and Semidefinite Programming (SDP) are fundamental combinatorial optimization problems, with many important…

Data Structures and Algorithms · Computer Science 2025-07-17 N. Efe Çekirge , William Gay , David P. Woodruff

Sparse recovery is among the most well-studied problems in learning theory and high-dimensional statistics. In this work, we investigate the statistical and computational landscapes of sparse recovery with $\ell_\infty$ error guarantees.…

Statistics Theory · Mathematics 2026-02-19 Ziyun Chen , Jerry Li , Kevin Tian , Yusong Zhu

Feature selection is the problem of selecting a subset of features for a machine learning model that maximizes model quality subject to a budget constraint. For neural networks, prior methods, including those based on $\ell_1$…

Machine Learning · Computer Science 2024-06-19 Taisuke Yasuda , MohammadHossein Bateni , Lin Chen , Matthew Fahrbach , Gang Fu , Vahab Mirrokni

Most commonly used \emph{adaptive} algorithms for univariate real-valued function approximation and global minimization lack theoretical guarantees. Our new locally adaptive algorithms are guaranteed to provide answers that satisfy a…

Numerical Analysis · Mathematics 2017-08-28 Sou-Cheng T. Choi , Yuhan Ding , Fred J. Hickernell , Xin Tong

In the Max-Cut problem in the streaming model, an algorithm is given the edges of an unknown graph $G = (V,E)$ in some fixed order, and its goal is to approximate the size of the largest cut in $G$. Improving upon an earlier result of…

Data Structures and Algorithms · Computer Science 2025-09-08 Yumou Fei , Dor Minzer , Shuo Wang

We consider the SUBSET SUM problem and its important variants in this paper. In the SUBSET SUM problem, a (multi-)set $X$ of $n$ positive numbers and a target number $t$ are given, and the task is to find a subset of $X$ with the maximal…

Data Structures and Algorithms · Computer Science 2022-12-07 Xiaoyu Wu , Lin Chen

This paper addresses a fundamental problem in random variate generation: given access to a random source that emits a stream of independent fair bits, what is the most accurate and entropy-efficient algorithm for sampling from a discrete…

Data Structures and Algorithms · Computer Science 2020-03-10 Feras A. Saad , Cameron E. Freer , Martin C. Rinard , Vikash K. Mansinghka

Given a set of points in the plane, the \textsc{General Position Subset Selection} problem is that of finding a maximum-size subset of points in general position, i.e., with no three points collinear. The problem is known to be ${\rm…

Computational Geometry · Computer Science 2025-04-01 Adrian Dumitrescu

We study approximation algorithms for the following three string measures that are widely used in practice: edit distance (ED), longest common subsequence (LCS), and longest increasing sequence (LIS). All three problems can be solved…

Data Structures and Algorithms · Computer Science 2020-07-28 Kuan Cheng , Zhengzhong Jin , Xin Li , Yu Zheng

When, in terms of the number of data points, the size of a dataset exceeds available computing resources, or when labeling is expensive, an attractive solution consists of selecting only some of the data points (subdata) for further…

Methodology · Statistics 2026-04-28 Min Yang , Wei Zheng , John Stufken , Ming-Chung Chang , Ting Tian , Xueqin Wang

The classical work of (Arora et al., 1999) provides a scheme that gives, for any $\epsilon>0$, a polynomial time $1-\epsilon$ approximation algorithm for dense instances of a family of $\mathcal{NP}$-hard problems, such as Max-CUT and…

Data Structures and Algorithms · Computer Science 2024-05-24 Evripidis Bampis , Bruno Escoffier , Michalis Xefteris

Best subset selection in linear regression is well known to be nonconvex and computationally challenging to solve, as the number of possible subsets grows rapidly with increasing dimensionality of the problem. As a result, finding the…

Machine Learning · Statistics 2025-04-01 Vikram Singh , Min Sun

We develop an randomized approximation algorithm for the size of set union problem $\arrowvert A_1\cup A_2\cup...\cup A_m\arrowvert$, which given a list of sets $A_1,...,A_m$ with approximate set size $m_i$ for $A_i$ with $m_i\in…

Data Structures and Algorithms · Computer Science 2018-06-18 Bin Fu , Pengfei Gu , Yuming Zhao

We are given n base elements and a finite collection of subsets of them. The size of any subset varies between p to k (p < k). In addition, we assume that the input contains all possible subsets of size p. Our objective is to find a…

Data Structures and Algorithms · Computer Science 2009-06-09 Asaf Levin , Uri Yovel

This paper studies a classic maximum entropy sampling problem (MESP), which aims to select the most informative principal submatrix of a prespecified size from a covariance matrix. MESP has been widely applied to many areas, including…

Machine Learning · Statistics 2023-05-02 Yongchun Li , Weijun Xie

The (Non-Preemptive) Throughput Maximization problem is a natural and fundamental scheduling problem. We are given $n$ jobs, where each job $j$ is characterized by a processing time and a time window, contained in a global interval $[0,T)$,…

Data Structures and Algorithms · Computer Science 2026-04-01 Alexander Armbruster , Fabrizio Grandoni , Antoine Tinguely , Andreas Wiese