English
Related papers

Related papers: Sparse domination of sharp variational truncations

200 papers

It has by now become a standard approach to use the theory of sparse (or toric) elimination, based on the Newton polytope of a polynomial, in order to reveal and exploit the structure of algebraic systems. This talk surveys compact…

Computational Complexity · Computer Science 2017-10-16 Ioannis Emiris

In this work we propose to fit a sparse logistic regression model by a weakly convex regularized nonconvex optimization problem. The idea is based on the finding that a weakly convex function as an approximation of the $\ell_0$ pseudo norm…

Machine Learning · Computer Science 2018-05-23 Xinyue Shen , Yuantao Gu

We consider a Bayesian framework for estimating a high-dimensional sparse precision matrix, in which adaptive shrinkage and sparsity are induced by a mixture of Laplace priors. Besides discussing our formulation from the Bayesian…

Machine Learning · Statistics 2018-05-22 Lingrui Gan , Naveen N. Narisetty , Feng Liang

Motivated by recent work on stochastic gradient descent methods, we develop two stochastic variants of greedy algorithms for possibly non-convex optimization problems with sparsity constraints. We prove linear convergence in expectation to…

Numerical Analysis · Mathematics 2014-07-02 Nam Nguyen , Deanna Needell , Tina Woolf

We present a parametric deterministic formulation of Bayesian inverse problems with input parameter from infinite dimensional, separable Banach spaces. In this formulation, the forward problems are parametric, deterministic elliptic partial…

Analysis of PDEs · Mathematics 2015-05-27 Ch. Schwab , A. M. Stuart

Currently several Bayesian approaches are available to estimate large sparse precision matrices, including Bayesian graphical Lasso (Wang, 2012), Bayesian structure learning (Banerjee and Ghosal, 2015), and graphical horseshoe (Li et al.,…

Methodology · Statistics 2021-04-27 Ruoyang Zhang , Yisha Yao , Malay Ghosh

A key recent advance in face recognition models a test face image as a sparse linear combination of a set of training face images. The resulting sparse representations have been shown to possess robustness against a variety of distortions…

Computer Vision and Pattern Recognition · Computer Science 2011-11-09 Yi Chen , Umamahesh Srinivas , Thong T. Do , Vishal Monga , Trac D. Tran

So-called sparse estimators arise in the context of model fitting, when one a priori assumes that only a few (unknown) model parameters deviate from zero. Sparsity constraints can be useful when the estimation problem is under-determined,…

Machine Learning · Statistics 2017-03-22 Jean Daunizeau

In this paper we consider bilinear sparse forms intimately related to iterated commutators of a rather general class of operators. We establish Bloom weighted estimates for these forms in the full range of exponents, both in the diagonal…

Classical Analysis and ODEs · Mathematics 2024-05-31 Andrei K. Lerner , Emiel Lorist , Sheldy Ombrosi

We prove quantitative, one-weight, weak-type estimates for maximal operators, singular integrals, fractional maximal operators and fractional integral operators. We consider a kind of weak-type inequality that was first studied by…

Classical Analysis and ODEs · Mathematics 2023-11-03 David Cruz-Uribe , Brandon Sweeting

This paper presents a novel approach to characterize the dynamics of the limit spectrum of large random matrices. This approach is based upon the notion we call "spectral dominance". In particular, we show that the limit spectral measure…

Analysis of PDEs · Mathematics 2021-05-20 Charles Bertucci , Mérouane Debbah , Jean-Michel Lasry , Pierre-Louis Lions

We study pointwise estimation and uncertainty quantification for a sparse variational Gaussian process method with eigenvector inducing variables. For a rescaled Brownian motion prior, we derive theoretical guarantees and limitations for…

Statistics Theory · Mathematics 2023-11-01 Luke Travis , Kolyan Ray

We show that any Littlewood--Paley square function $S$ satisfying a minimal local testing condition is dominated by a sparse form, \begin{equation*} \langle (Sf)^2,g \rangle\le C \sum_{I \in \mathscr{S}} \langle \lvert f\rvert\rangle_I^2…

Classical Analysis and ODEs · Mathematics 2020-11-03 Gianmarco Brocchi

We investigate a generalized framework to estimate a latent low-rank plus sparse tensor, where the low-rank tensor often captures the multi-way principal components and the sparse tensor accounts for potential model mis-specifications or…

Methodology · Statistics 2022-04-15 Jian-Feng Cai , Jingyang Li , Dong Xia

Nonparametric regression problems with qualitative constraints such as monotonicity or convexity are ubiquitous in applications. For example, in predicting the yield of a factory in terms of the number of labor hours, the monotonicity of…

Statistics Theory · Mathematics 2023-11-21 Soham Mallick , Siddhaarth Sarkar , Arun Kumar Kuchibhotla

Firstly, we invoke the weak convergence (resp. strong convergence) of translated basic methods involving nonexpansive operators to establish the weak convergence (resp. strong convergence) of the associated method with both perturbation and…

Optimization and Control · Mathematics 2022-03-29 Hui Ouyang

Several convex formulation methods have been proposed previously for statistical estimation with structured sparsity as the prior. These methods often require a carefully tuned regularization parameter, often a cumbersome or heuristic…

Machine Learning · Statistics 2016-03-23 Sohail Bahmani , Petros T. Boufounos , Bhiksha Raj

Inspired by Kalikow-type decompositions, we introduce a new stochastic model of infinite neuronal networks, for which we establish sharp oracle inequalities for Lasso methods and restricted eigenvalue properties for the associated Gram…

Statistics Theory · Mathematics 2019-08-13 Guilherme Ost , Patricia Reynaud-Bouret

In this work we study the asymptotic consistency of the weak-form sparse identification of nonlinear dynamics algorithm (WSINDy) in the identification of differential equations from noisy samples of solutions. We prove that the WSINDy…

Numerical Analysis · Mathematics 2022-11-30 Daniel A. Messenger , David M. Bortz

In this work we derive global estimates for viscosity solutions to fully nonlinear elliptic equations under relaxed structural assumptions on the governing operator which are weaker than convexity and oblique boundary conditions and under…

Analysis of PDEs · Mathematics 2023-06-02 Junior da S. Bessa , João Vitor da Silva , Maria N. B. Frederico , Gleydson C. Ricarte