English
Related papers

Related papers: Randomized Complexity of Vector-Valued Approximati…

200 papers

The problem of estimating the number $n$ of distinct keys of a large collection of $N$ data is well known in computer science. A classical algorithm is the adaptive sampling (AS). $n$ can be estimated by $R.2^D$, where $R$ is the final…

Data Structures and Algorithms · Computer Science 2019-05-17 Matthew Drescher , Guy Louchard , Yvik Swan

The problem we concentrate on is as follows: given (1) a convex compact set $X$ in ${\mathbb{R}}^n$, an affine mapping $x\mapsto A(x)$, a parametric family $\{p_{\mu}(\cdot)\}$ of probability densities and (2) $N$ i.i.d. observations of the…

Statistics Theory · Mathematics 2009-08-24 Anatoli B. Juditsky , Arkadi S. Nemirovski

Machine learning models with inputs in a Euclidean space $\mathbb{R}^d$, when implemented on digital computers, generalize, and their generalization gap converges to $0$ at a rate of $c/N^{1/2}$ concerning the sample size $N$. However, the…

Machine Learning · Computer Science 2026-05-14 Anastasis Kratsios , A. Martina Neuman , Gudmund Pammer

Traditional nonparametric estimation methods often lead to a slow convergence rate in large dimensions and require unrealistically enormous sizes of datasets for reliable conclusions. We develop an approach based on partial derivatives,…

Methodology · Statistics 2024-08-20 Xiaowu Dai

Robust estimators for linear regression require non-convex objective functions to shield against adverse affects of outliers. This non-convexity brings challenges, particularly when combined with penalization in high-dimensional settings.…

Computation · Statistics 2025-08-08 David Kepplinger , Siqi Wei

A regularization algorithm allowing random noise in derivatives and inexact function values is proposed for computing approximate local critical points of any order for smooth unconstrained optimization problems. For an objective function…

Optimization and Control · Mathematics 2021-04-07 S. Bellavia , G. Gurioli , B. Morini , Ph. L. Toint

The nonnegative rank of a nonnegative matrix is the minimum number of nonnegative rank-one factors needed to reconstruct it exactly. The problem of determining this rank and computing the corresponding nonnegative factors is difficult;…

Optimization and Control · Mathematics 2012-08-30 Nicolas Gillis , François Glineur

This paper describes a flexible framework for generalized low-rank tensor estimation problems that includes many important instances arising from applications in computational imaging, genomics, and network analysis. The proposed estimator…

Statistics Theory · Mathematics 2021-02-08 Rungang Han , Rebecca Willett , Anru R. Zhang

We show that, assuming NP $\not\subseteq$ $\cap_{\delta > 0}$DTIME$\left(\exp{n^\delta}\right)$, the shortest vector problem for lattices of rank $n$ in any finite $\ell_p$ norm is hard to approximate within a factor of $2^{(\log n)^{1 -…

Computational Complexity · Computer Science 2026-04-07 Isaac M Hair , Amit Sahai

A fundamental issue in real-world systems, such as sensor networks, is the selection of observations which most effectively reduce uncertainty. More specifically, we address the long standing problem of nonmyopically selecting the most…

Artificial Intelligence · Computer Science 2012-07-09 Andreas Krause , Carlos E. Guestrin

Consider a graph problem that is locally checkable but not locally solvable: given a solution we can check that it is feasible by verifying all constant-radius neighborhoods, but to find a solution each node needs to explore the input graph…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-02-19 Will Rosenbaum , Jukka Suomela

We consider the task of interactive communication in the presence of adversarial errors and present tight bounds on the tolerable error-rates in a number of different settings. Most significantly, we explore adaptive interactive…

Data Structures and Algorithms · Computer Science 2022-08-09 Mohsen Ghaffari , Bernhard Haeupler , Madhu Sudan

When we speak about parametric programming, sensitivity analysis, or related topics, we usually mean the problem of studying specified perturbations of the data such that for a given optimization problem some optimality criterion remains…

Optimization and Control · Mathematics 2019-05-28 Milan Hladík

Although adaptive optimization algorithms have been successful in many applications, there are still some mysteries in terms of convergence analysis that have not been unraveled. This paper provides a novel non-convex analysis of adaptive…

Optimization and Control · Mathematics 2025-04-08 Zhishuai Guo , Yi Xu , Wotao Yin , Rong Jin , Tianbao Yang

This work considers the low-rank approximation of a matrix $A(t)$ depending on a parameter $t$ in a compact set $D \subset \mathbb{R}^d$. Application areas that give rise to such problems include computational statistics and dynamical…

Numerical Analysis · Mathematics 2024-04-18 Daniel Kressner , Hei Yin Lam

Let $G$ be a graph on $n$ vertices and $\mathrm{STAB}_k(G)$ be the convex hull of characteristic vectors of its independent sets of size at most $k$. We study extension complexity of $\mathrm{STAB}_k(G)$ with respect to a fixed parameter…

Computational Complexity · Computer Science 2017-03-08 Jakub Gajarský , Petr Hliněný , Hans Raj Tiwary

The average properties of the well-known Subset Sum Problem can be studied by the means of its randomised version, where we are given a target value $z$, random variables $X_1, \ldots, X_n$, and an error parameter $\varepsilon > 0$, and we…

We study the complexity of high-dimensional approximation in the $L_2$-norm when different classes of information are available; we compare the power of function evaluations with the power of arbitrary continuous linear measurements. Here,…

Numerical Analysis · Mathematics 2023-03-23 David Krieg , Pawel Siedlecki , Mario Ullrich , Henryk Woźniakowski

We propose a new adaptive hypothesis test for inequality (e.g., monotonicity, convexity) and equality (e.g., parametric, semiparametric) restrictions on a structural function in a nonparametric instrumental variables (NPIV) model. Our test…

Econometrics · Economics 2024-11-08 Christoph Breunig , Xiaohong Chen

Optimization problems involving complex variables, when solved, are typically transformed into real variables, often at the expense of convergence rate and interpretability. This paper introduces a novel formalism for a prominent problem in…

Optimization and Control · Mathematics 2025-04-07 Raneem Madani , Abdel Lisser