English
Related papers

Related papers: Sparse domination of sharp variational truncations

200 papers

In this paper we establish sharp weighted bounds (Buckley type theorems) for one{sided maximal and fractional integral operators in terms of one{sided $A_p$ characteristics. Appropriate sharp bounds for strong maximal functions, multiple…

Functional Analysis · Mathematics 2014-03-04 Vakhtang Kokilashvili , Alexander Meskhi , Muhammad Asad Zaighum

In a variety of application areas, there is a growing interest in analyzing high dimensional sparse count data, with sparsity exhibited by an over-abundance of zeros and small non-zero counts. Existing approaches for analyzing multivariate…

Methodology · Statistics 2016-04-15 Jyotishka Datta , David B. Dunson

We present the framework of slowly varying regression under sparsity, allowing sparse regression models to exhibit slow and sparse variations. The problem of parameter estimation is formulated as a mixed-integer optimization problem. We…

Machine Learning · Computer Science 2023-11-14 Dimitris Bertsimas , Vassilis Digalakis , Michael Linghzi Li , Omar Skali Lami

Stochastic gradient descent (SGD) is commonly used for optimization in large-scale machine learning problems. Langford et al. (2009) introduce a sparse online learning method to induce sparsity via truncated gradient. With high-dimensional…

Machine Learning · Statistics 2017-05-10 Yuting Ma , Tian Zheng

Structural damage due to excessive loading or environmental degradation typically occurs in localized areas in the absence of collapse. This prior information about the spatial sparseness of structural damage is exploited here by a…

Applications · Statistics 2015-03-29 Yong Huang , James L. Beck

In this article we study the strong unique continuation property for solutions of higher order (variable coefficient) fractional Schr\"odinger operators. We deduce the strong unique continuation property in the presence of subcritical and…

Analysis of PDEs · Mathematics 2019-02-27 María-Ángeles García-Ferrero , Angkana Rüland

We consider local weak solutions of the Poisson equation for the p--Laplace operator. We prove a higher differentiability result, under an essentially sharp condition on the right-hand side. The result comes with a local scaling invariant a…

Analysis of PDEs · Mathematics 2016-07-25 Lorenzo Brasco , Filippo Santambrogio

In this manuscript, we analyze the sparse signal recovery (compressive sensing) problem from the perspective of convex optimization by stochastic proximal gradient descent. This view allows us to significantly simplify the recovery analysis…

Data Structures and Algorithms · Computer Science 2013-04-19 Rong Jin , Tianbao Yang , Shenghuo Zhu

We connect high-dimensional subset selection and submodular maximization. Our results extend the work of Das and Kempe (2011) from the setting of linear regression to arbitrary objective functions. For greedy feature selection, this…

Machine Learning · Statistics 2017-10-13 Ethan R. Elenberg , Rajiv Khanna , Alexandros G. Dimakis , Sahand Negahban

In this paper, we have established a new framework of truncated inverse sampling for estimating mean values of non-negative random variables such as binomial, Poisson, hyper-geometrical, and bounded variables. We have derived explicit…

Statistics Theory · Mathematics 2013-11-05 Xinjia Chen

Dense embeddings deliver strong retrieval performance but often lack interpretability and controllability. This paper introduces a novel approach using sparse autoencoders (SAE) to interpret and control dense embeddings via the learned…

Information Retrieval · Computer Science 2025-02-25 Hao Kang , Tevin Wang , Chenyan Xiong

Many conventional statistical procedures are extremely sensitive to seemingly minor deviations from modeling assumptions. This problem is exacerbated in modern high-dimensional settings, where the problem dimension can grow with and…

Machine Learning · Statistics 2017-02-27 Simon S. Du , Sivaraman Balakrishnan , Aarti Singh

We prove sharp L^2 boundary decay estimates for the eigenfunctions of certain second order elliptic operators acting in a bounded region, and of their first order space derivatives, using only the Hardy inequality. We then deduce bounds on…

Spectral Theory · Mathematics 2007-05-23 E B Davies

Sparsity plays a central role in recent developments in signal processing, linear algebra, statistics, optimization, and other fields. In these developments, sparsity is promoted through the addition of an $L^1$ norm (or related quantity)…

Analysis of PDEs · Mathematics 2014-08-04 Russel E. Caflisch , Stanley J. Osher , Hayden Schaeffer , Giang Tran

Sparse optimization receives increasing attention in many applications such as compressed sensing, variable selection in regression problems, and recently neural network compression in machine learning. For example, the problem of…

Optimization and Control · Mathematics 2022-09-29 Saeed Damadi , Jinglai Shen

We introduce a general distributional framework that results in a unifying description and characterization of a rich variety of continuous-time stochastic processes. The cornerstone of our approach is an innovation model that is driven by…

Information Theory · Computer Science 2015-03-19 Michael Unser , Pouya D. Tafti , Qiyu Sun

When training data is sparse, more domain knowledge must be incorporated into the learning algorithm in order to reduce the effective size of the hypothesis space. This paper builds on previous work in which knowledge about qualitative…

Machine Learning · Computer Science 2012-07-09 Eric E. Altendorf , Angelo C. Restificar , Thomas G. Dietterich

The observations in many applications consist of counts of discrete events, such as photons hitting a dector, which cannot be effectively modeled using an additive bounded or Gaussian noise model, and instead require a Poisson noise model.…

Optimization and Control · Mathematics 2016-11-17 Zachary T. Harmany , Roummel F. Marcia , Rebecca M. Willett

Linear mixed models are a versatile statistical tool to study data by accounting for fixed effects and random effects from multiple sources of variability. In many situations, a large number of candidate fixed effects is available and it is…

Methodology · Statistics 2022-09-09 Emanuele Degani , Luca Maestrini , Dorota Toczydłowska , Matt P. Wand

Sparse linear discriminant analysis via penalized optimal scoring is a successful tool for classification in high-dimensional settings. While the variable selection consistency of sparse optimal scoring has been established, the…

Statistics Theory · Mathematics 2021-04-01 Irina Gaynanova