English
Related papers

Related papers: A Note on Sparse Supersaturation and Extremal Resu…

200 papers

Large sparse symmetric linear systems appear in several branches of science and engineering thanks to the widespread use of the finite element method (FEM). The fastest sparse linear solvers available implement hybrid iterative methods.…

Machine Learning · Computer Science 2022-03-15 Luca Grementieri , Paolo Galeone

We develop a hypergraph container method for the Boolean Satisfiability Problem (SAT) via the newly developed container results [Campos and Samotij (2024)]. This provides an explicit connection between the extent of spread of clauses and…

Combinatorics · Mathematics 2026-04-17 Zicheng Han , Yupeng Lin , Jie Ma , Xiande Zhang

We present a framework to define a large class of neural networks for which, by construction, training by gradient flow provably reaches arbitrarily low loss when the number of parameters grows. Distinct from the fixed-space global…

Optimization and Control · Mathematics 2025-01-13 David A. R. Robin , Kevin Scaman , Marc Lelarge

We present two sets of theoretical results on the grouped lasso with overlap of Jacob, Obozinski and Vert (2009) in the linear regression setting. This method allows for joint selection of predictors in sparse regression, allowing for…

Machine Learning · Statistics 2011-11-11 Daniel Percival

Recently there has been much interest in "sparsifying" sums of rank one matrices: modifying the coefficients such that only a few are nonzero, while approximately preserving the matrix that results from the sum. Results of this sort have…

Discrete Mathematics · Computer Science 2018-01-30 Marcel K. de Carli Silva , Nicholas J. A. Harvey , Cristiane M. Sato

Patterned random matrices such as the reverse circulant, the symmetric circulant, the Toeplitz and the Hankel matrices and their almost sure limiting spectral distribution (LSD), have attracted much attention. Under the assumption that the…

Probability · Mathematics 2022-03-14 Arup Bose , Koushik Saha , Priyanka Sen

Noisy matrix completion has attracted significant attention due to its applications in recommendation systems, signal processing and image restoration. Most existing works rely on (weighted) least squares methods under various low-rank…

Machine Learning · Statistics 2024-12-17 Ziyuan Chen , Fang Yao

We consider the matrix completion problem where the aim is to esti-mate a large data matrix for which only a relatively small random subset of its entries is observed. Quite popular approaches to matrix completion problem are iterative…

Statistics Theory · Mathematics 2015-02-03 Olga Klopp

The first paper in this series introduced a new approach to strong convergence of random matrices that is based primarily on soft arguments. This method was applied to achieve a refined qualitative and quantitative understanding of strong…

Probability · Mathematics 2024-12-17 Chi-Fang Chen , Jorge Garza-Vargas , Ramon van Handel

The random reshuffling Kaczmarz (RRK) method enjoys the simplicity and efficiency in solving linear systems as a Kaczmarz-type method, whereas it also inherits the practical improvements of the stochastic gradient descent (SGD) with random…

Numerical Analysis · Mathematics 2025-08-08 Deren Han , Jiaxin Xie

Convergence of the solutions of nonhomogeneous linear singularly perturbed systems to that of the corresponding reduced singular system on the half-line [0, $\infty $) is considered. To include the situation on a neighborhood of initial…

Optimization and Control · Mathematics 2008-05-27 Zhibin Yan

Sketch-and-project is a framework which unifies many known iterative methods for solving linear systems and their variants, as well as further extensions to non-linear optimization problems. It includes popular methods such as randomized…

Optimization and Control · Mathematics 2023-09-20 Michał Dereziński , Elizaveta Rebrova

We consider inhomogeneous matrix products over max-plus algebra, where the matrices in the product satisfy certain assumptions under which the matrix products of sufficient length be rank-one, as it was shown in [6][L. Shue, B.D.O.…

Rings and Algebras · Mathematics 2019-04-15 Arthur Kennedy Cochran Patrick , Sergei Sergeev , Štefan Berežný

A new statistical model designed for regression analysis with a sparse design matrix is proposed. This new model utilizes the positions of the limited non-zero elements in the design matrix to decompose the regression model into…

Applications · Statistics 2022-01-17 Hsien-Wei Chen

We consider the problem of reconstructing an infinite set of sparse, finite-dimensional vectors, that share a common sparsity pattern, from incomplete measurements. This is in contrast to the work [17], where the single vector signal can be…

Optimization and Control · Mathematics 2021-11-29 Nick Dexter , Hoang Tran , Clayton Webster

Recently, the study on learned iterative shrinkage thresholding algorithm (LISTA) has attracted increasing attentions. A large number of experiments as well as some theories have proved the high efficiency of LISTA for solving sparse coding…

Machine Learning · Computer Science 2021-06-24 Lin Kong , Wei Sun , Fanhua Shang , Yuanyuan Liu , Hongying Liu

We study thresholds for extremal properties of random discrete structures. We determine the threshold for Szemer\'edi's theorem on arithmetic progressions in random subsets of the integers and its multidimensional extensions and we…

Combinatorics · Mathematics 2016-09-20 Mathias Schacht

For random combinatorial optimization problems, there has been much progress in establishing laws of large numbers and computing limiting constants for the optimal value of various problems. However, there has not been as much success in…

Probability · Mathematics 2020-08-24 Sky Cao

This work considers methods for imposing sparsity in Bayesian regression with applications in nonlinear system identification. We first review automatic relevance determination (ARD) and analytically demonstrate the need to additional…

Machine Learning · Statistics 2021-02-24 Samuel H. Rudy , Themistoklis P. Sapsis

We consider self-similar approximations of nonlinear hyperbolic systems in one space dimension with Riemann initial data and general diffusion matrix. We assume that the matrix of the system is strictly hyperbolic and the diffusion matrix…

Analysis of PDEs · Mathematics 2008-12-16 K. T. Joseph , Philippe G. LeFloch