English
Related papers

Related papers: Hardness of Sparse Sets and Minimal Circuit Size P…

200 papers

In this work we are interested in the problems of supervised learning and variable selection when the input-output dependence is described by a nonlinear function depending on a few variables. Our goal is to consider a sparse nonparametric…

Machine Learning · Statistics 2012-08-14 Lorenzo Rosasco , Silvia Villa , Sofia Mosci , Matteo Santoro , Alessandro verri

Large-scale subset selection asks for a small useful set of examples, features, sensors, seed users, or context passages from an enormous ground set. Submodular maximization is a canonical model for such diminishing-returns problems, but…

Data Structures and Algorithms · Computer Science 2026-05-07 Alan Kuhnle

In this paper, we study a class of approximation problems, appearing in data approximation and signal processing. The approximations are constructed as combinations of polynomial splines (piecewise polynomials), whose parameters are subject…

Optimization and Control · Mathematics 2015-03-05 Zahra Roshan Zamir , Nadezda Sukhorukova

Maintaining and updating shortest paths information in a graph is a fundamental problem with many applications. As computations on dense graphs can be prohibitively expensive, and it is preferable to perform the computations on a sparse…

Data Structures and Algorithms · Computer Science 2021-09-21 Thiago Bergamaschi , Monika Henzinger , Maximilian Probst Gutenberg , Virginia Vassilevska Williams , Nicole Wein

The stochastic proximal point (SPP) methods have gained recent attention for stochastic optimization, with strong convergence guarantees and superior robustness to the classic stochastic gradient descent (SGD) methods showcased at little to…

Machine Learning · Statistics 2023-01-10 Xiao-Tong Yuan , Ping Li

Let $\gamma$-$\mathsf{GapSVP}_p$ be the decision version of the shortest vector problem in the $\ell_p$-norm with approximation factor $\gamma$, let $n$ be the lattice rank and $0<\varepsilon\leq 1$. We prove that there is no algorithm that…

Number Theory · Mathematics 2026-03-24 Markus Hittmeir

We study the minimum number of constraints needed to formulate random instances of the maximum stable set problem via linear programs (LPs), in two distinct models. In the uniform model, the constraints of the LP are not allowed to depend…

Computational Complexity · Computer Science 2016-10-26 Gábor Braun , Samuel Fiorini , Sebastian Pokutta

The problem of minimizing a polynomial over a set of polynomial inequalities is an NP-hard non-convex problem. Thanks to powerful results from real algebraic geometry, one can convert this problem into a nested sequence of…

Optimization and Control · Mathematics 2022-08-26 Victor Magron , Jie Wang

In pursuit of a deeper understanding of Boolean Promise Constraint Satisfaction Problems (PCSPs), we identify a class of problems with restricted structural complexity, which could serve as a promising candidate for complete…

Computational Complexity · Computer Science 2025-10-01 Katzper Michno

Sparse optimization is a central problem in machine learning and computer vision. However, this problem is inherently NP-hard and thus difficult to solve in general. Combinatorial search methods find the global optimal solution but are…

Optimization and Control · Mathematics 2020-06-30 Ganzhao Yuan , Li Shen , Wei-Shi Zheng

The ever-increasing number of parameters in deep neural networks poses challenges for memory-limited applications. Regularize-and-prune methods aim at meeting these challenges by sparsifying the network weights. In this context we quantify…

Machine Learning · Computer Science 2018-10-30 Enzo Tartaglione , Skjalg Lepsøy , Attilio Fiandrotti , Gianluca Francini

Makespan minimization on unrelated machines is a classic problem in approximation algorithms. No polynomial time $(2-\delta)$-approximation algorithm is known for the problem for constant $\delta> 0$. This is true even for certain special…

Data Structures and Algorithms · Computer Science 2014-10-29 Deeparnab Chakrabarty , Sanjeev Khanna , Shi Li

We investigate the complexity of short symbolic sequences of chaotic dynamical systems by using lossless compression algorithms. In particular, we study Non-Sequential Recursive Pair Substitution (NSRPS), a lossless compression algorithm…

Chaotic Dynamics · Physics 2015-03-17 Nithin Nagaraj , Mathew Shaji Kavalekalam , Arjun Venugopal T. , Nithin Krishnan

We present a deterministic 2^O(t)q^{(t-2)(t-1)+o(1)} algorithm to decide whether a univariate polynomial f, with exactly t monomial terms and degree <q, has a root in F_q. A corollary of our method --- the first with complexity sub-linear…

Number Theory · Mathematics 2013-09-03 Jingguo Bi , Qi Cheng , J. Maurice Rojas

The computation of the sparse principal component of a matrix is equivalent to the identification of its principal submatrix with the largest maximum eigenvalue. Finding this optimal submatrix is what renders the problem…

Information Theory · Computer Science 2013-12-23 Megasthenis Asteris , Dimitris S. Papailiopoulos , George N. Karystinos

The secret protection problem (SPP) seeks to synthesize a minimum-cost policy ensuring that every execution from an initial state to a secret state includes a sufficient number of protected events. Previous work showed that the problem is…

Formal Languages and Automata Theory · Computer Science 2025-09-19 Tomáš Masopust , Jakub Večeřa

On solving a convex-concave bilinear saddle-point problem (SPP), there have been many works studying the complexity results of first-order methods. These results are all about upper complexity bounds, which can determine at most how many…

Optimization and Control · Mathematics 2018-08-10 Yuyuan Ouyang , Yangyang Xu

In this paper we study the problem of finding a small safe set $S$ in a graph $G$, i.e. a non-empty set of vertices such that no connected component of $G[S]$ is adjacent to a larger component in $G - S$. We enhance our understanding of the…

Computational Complexity · Computer Science 2019-02-01 Rémy Belmonte , Tesshu Hanaka , Ioannis Katsikarelis , Michael Lampis , Hirotaka Ono , Yota Otachi

Given a sample covariance matrix, we examine the problem of maximizing the variance explained by a linear combination of the input variables while constraining the number of nonzero coefficients in this combination. This is known as sparse…

Artificial Intelligence · Computer Science 2011-11-10 Alexandre d'Aspremont , Francis Bach , Laurent El Ghaoui

We investigate computational problems involving large weights through the lens of kernelization, which is a framework of polynomial-time preprocessing aimed at compressing the instance size. Our main focus is the weighted Clique problem,…

Data Structures and Algorithms · Computer Science 2021-07-07 Bart M. P. Jansen , Shivesh K. Roy , Michał Włodarczyk