English
Related papers

Related papers: Near-Optimal Time-Sparsity Trade-Offs for Solving …

200 papers

We consider approximations of signals by the elements of a frame in a complex vector space of dimension $N$ and formulate both the noiseless and the noisy sparse representation problems. The noiseless representation problem is to find…

Information Theory · Computer Science 2007-07-13 Mehmet Akçakaya , Vahid Tarokh

This work proposes a new moment-SOS hierarchy, called CS-TSSOS, for solving large-scale sparse polynomial optimization problems. Its novelty is to exploit simultaneously correlative sparsity and term sparsity by combining advantages of two…

Optimization and Control · Mathematics 2021-06-10 Jie Wang , Victor Magron , Jean B. Lasserre , Ngoc Hoang Anh Mai

Consider the fundamental task of finding independent sets of (constant) size $k$ in a given $n$-node hypergraph. How is the time complexity affected by the sparsity of the input, i.e., the number of hyperedges $m$? Tur\'{a}n's theorem…

Computational Complexity · Computer Science 2026-05-12 Timo Fritsch , Marvin Künnemann , Mirza Redzic , Julian Stieß

Unlike the matrix case, computing low-rank approximations of tensors is NP-hard and numerically ill-posed in general. Even the best rank-1 approximation of a tensor is NP-hard. In this paper, we use convex optimization to develop…

Statistics Theory · Mathematics 2016-09-14 Anil Aswani

Given a way to evaluate an unknown polynomial with integer coefficients, we present new algorithms to recover its nonzero coefficients and corresponding exponents. As an application, we adapt this interpolation algorithm to the problem of…

Symbolic Computation · Computer Science 2022-05-19 Pascal Giorgi , Bruno Grenet , Armelle Perret du Cray , Daniel S. Roche

We formulate the sparse classification problem of $n$ samples with $p$ features as a binary convex optimization problem and propose a cutting-plane algorithm to solve it exactly. For sparse logistic regression and sparse SVM, our algorithm…

Optimization and Control · Mathematics 2025-01-08 Dimitris Bertsimas , Jean Pauphilet , Bart Van Parys

We investigate adaptive sublinear algorithms for detecting monotone patterns in an array. Given fixed $2 \leq k \in \mathbb{N}$ and $\varepsilon > 0$, consider the problem of finding a length-$k$ increasing subsequence in an array $f \colon…

Data Structures and Algorithms · Computer Science 2019-11-05 Omri Ben-Eliezer , Shoham Letzter , Erik Waingarten

We are concerned with the fastest possible direct numerical solution algorithm for a thin-banded or tridiagonal linear system of dimension $N$ on a distributed computing network of $N$ nodes that is connected in a binary communication tree.…

Numerical Analysis · Mathematics 2018-02-02 Martin Neuenhofen

We give a polynomial-time approximation algorithm for the (not necessarily metric) $k$-Median problem. The algorithm is an $\alpha$-size-approximation algorithm for $\alpha < 1 + 2 \ln(n/k)$. That is, it guarantees a solution having size at…

Data Structures and Algorithms · Computer Science 2025-11-18 Neal E. Young

We consider the following signal recovery problem: given a measurement matrix $\Phi\in \mathbb{R}^{n\times p}$ and a noisy observation vector $c\in \mathbb{R}^{n}$ constructed from $c = \Phi\theta^* + \epsilon$ where $\epsilon\in…

Machine Learning · Statistics 2013-07-23 Ji Liu , Lei Yuan , Jieping Ye

In this paper, we establish sample complexity bounds for learning high-dimensional simplices in $\mathbb{R}^K$ from noisy data. Specifically, we consider $n$ i.i.d. samples uniformly drawn from an unknown simplex in $\mathbb{R}^K$, each…

Machine Learning · Statistics 2025-06-13 Seyed Amir Hossein Saberi , Amir Najafi , Abolfazl Motahari , Babak H. khalaj

Noise-tolerant PAC learning of linear models has been of central interests in machine learning community since the last century. In recent years, many computationally-efficient algorithms have been proposed for the problem of learning…

Machine Learning · Computer Science 2026-05-19 Rita Adhikari , Shiwei Zeng

We study the algorithmic problem of sparse mean estimation in the presence of adversarial outliers. Specifically, the algorithm observes a \emph{corrupted} set of samples from $\mathcal{N}(\mu,\mathbf{I}_d)$, where the unknown mean $\mu \in…

Data Structures and Algorithms · Computer Science 2024-03-08 Ankit Pensia

Robust learning in expressive languages with real-world data continues to be a challenging task. Numerous conventional methods appeal to heuristics without any assurances of robustness. While probably approximately correct (PAC) Semantics…

Artificial Intelligence · Computer Science 2021-09-08 Alexander P. Rader , Ionela G. Mocanu , Vaishak Belle , Brendan Juba

We make progress on two important problems regarding attribute efficient learnability. First, we give an algorithm for learning decision lists of length $k$ over $n$ variables using $2^{\tilde{O}(k^{1/3})} \log n$ examples and time…

Machine Learning · Computer Science 2007-05-23 Adam R. Klivans , Rocco A. Servedio

Many regression and classification procedures fit a parameterized function $f(x;w)$ of predictor variables $x$ to data $\{x_{i},y_{i}\}_1^N$ based on some loss criterion $L(y,f)$. Often, regularization is applied to improve accuracy by…

Machine Learning · Computer Science 2021-07-16 Gilmer Valdes , Wilmer Arbelo , Yannet Interian , Jerome H. Friedman

A numerical method for solving elliptic PDEs with variable coefficients on two-dimensional domains is presented. The method is based on high-order composite spectral approximations and is designed for problems with smooth solutions. The…

Numerical Analysis · Mathematics 2013-07-11 A. Gillman , P. G. Martinsson

The sparse polynomial approximation of continuous functions has emerged as a prominent area of interest in function approximation theory in recent years. A key challenge within this domain is the accurate estimation of approximation errors.…

Numerical Analysis · Mathematics 2025-06-10 Renzhong Feng , Bowen Zhang

We study the problem of recovering an incomplete $m\times n$ matrix of rank $r$ with columns arriving online over time. This is known as the problem of life-long matrix completion, and is widely applied to recommendation system, computer…

Machine Learning · Computer Science 2016-12-04 Maria-Florina Balcan , Hongyang Zhang

In this work we revisit the elementary scheduling problem $1||\sum p_j U_j$. The goal is to select, among $n$ jobs with processing times and due dates, a subset of jobs with maximum total processing time that can be scheduled in sequence…

Data Structures and Algorithms · Computer Science 2025-07-23 Nick Fischer , Leo Wennmann