English
Related papers

Related papers: Box constrained $\ell_1$ optimization in random li…

200 papers

Consider the use of $\ell_{1}/\ell_{\infty}$-regularized regression for joint estimation of a $\pdim \times \numreg$ matrix of regression coefficients. We analyze the high-dimensional scaling of $\ell_1/\ell_\infty$-regularized quadratic…

Statistics Theory · Mathematics 2009-05-12 S. Negahban , M. J. Wainwright

One of the most basic problems in compressed sensing is solving an under-determined system of linear equations. Although this problem seems rather hard certain $\ell_1$-optimization algorithm appears to be very successful in solving it. The…

Information Theory · Computer Science 2009-07-22 Mihailo Stojnic

Solutions to the interval observation problem for delayed impulsive and switched systems with $L_1$-performance are provided. The approach is based on first obtaining stability and $L_1/\ell_1$-to-$L_1/\ell_1$ performance analysis…

Optimization and Control · Mathematics 2018-10-16 Corentin Briat

Despite many applications, dimensionality reduction in the $\ell_1$-norm is much less understood than in the Euclidean norm. We give two new oblivious dimensionality reduction techniques for the $\ell_1$-norm which improve exponentially…

Data Structures and Algorithms · Computer Science 2021-08-09 Yi Li , David P. Woodruff , Taisuke Yasuda

Recently, the worse-case analysis, probabilistic analysis and empirical justification have been employed to address the fundamental question: When does $\ell_1$-minimization find the sparsest solution to an underdetermined linear system? In…

Information Theory · Computer Science 2015-06-16 Yunbin Zhao

We study the problem of estimating $\beta \in \mathbb{R}^p$ from its noisy linear observations $y= X\beta+ w$, where $w \sim N(0, \sigma_w^2 I_{n\times n})$, under the following high-dimensional asymptotic regime: given a fixed number…

Statistics Theory · Mathematics 2017-10-23 Haolei Weng , Arian Maleki , Le Zheng

We conducted an extensive computational experiment, lasting multiple CPU-years, to optimally select parameters for two important classes of algorithms for finding sparse solutions of underdetermined systems of linear equations. We make the…

Numerical Analysis · Computer Science 2015-05-14 Arian Maleki , David L. Donoho

We consider a mechanism for area preserving Hamiltonian systems which leads to the enhanced probability, $P(\lambda, t)$, to find small values of the finite time Lyapunov exponent, $\lambda$. In our investigation of chaotic dynamical…

Chaotic Dynamics · Physics 2007-05-23 P. G. Silvestrov , I. V. Ponomarev

This work provides new results for the analysis of random sequences in terms of $\ell_p$-compressibility. The results characterize the degree in which a random sequence can be approximated by its best $k$-sparse version under different…

Methodology · Statistics 2021-07-09 Jorge F. Silva

This paper investigates the box-constrained $\ell_0$-regularized sparse optimization problem. We introduce the concept of a $\tau$-stationary point and establish its connection to the local and global minima of the box-constrained…

Optimization and Control · Mathematics 2025-05-26 Yuge Ye , Qingna Li

We study the theoretical limits of the $\ell_0$ (quasi) norm based optimization algorithms when employed for solving classical compressed sensing or sparse regression problems. Considering standard contexts with deterministic signals and…

Machine Learning · Statistics 2024-10-11 Mihailo Stojnic

The paper addresses parametric inequality systems described by polynomial functions in finite dimensions, where state-dependent infinite parameter sets are given by finitely many polynomial inequalities and equalities. Such systems can be…

Optimization and Control · Mathematics 2015-09-15 G. Li , B. S. Mordukhovich , T. T. A. Nghia , T. S. Pham

We extend the standard semiclassical theory of Excited-State Quantum Phase Transitions (ESQPTs), based on a classification of stationary points in the classical Hamiltonian, to constrained systems. We adopt the method of Lagrange…

Quantum Physics · Physics 2025-02-24 Jakub Novotný , Pavel Stránský , Pavel Cejnar

Linear Dynamical System (LDS) is an elegant mathematical framework for modeling and learning multivariate time series. However, in general, it is difficult to set the dimension of its hidden state space. A small number of hidden states may…

Artificial Intelligence · Computer Science 2013-12-04 Zitao Liu , Milos Hauskrecht

The $P_1$--nonconforming quadrilateral finite element space with periodic boundary condition is investigated. The dimension and basis for the space are characterized with the concept of minimally essential discrete boundary conditions. We…

Numerical Analysis · Mathematics 2022-01-27 Jaeryun Yim , Dongwoo Sheen

We are interested in numerical algorithms for computing the electrical field generated by a charge distribution localized on scale $\ell$ in an infinite heterogeneous medium, in a situation where the medium is only known in a box of…

Analysis of PDEs · Mathematics 2024-07-24 Jianfeng Lu , Felix Otto , Lihan Wang

Solving under-determined systems of linear equations with sparse solutions attracted enormous amount of attention in recent years, above all, due to work of \cite{CRT,CanRomTao06,DonohoPol}. In \cite{CRT,CanRomTao06,DonohoPol} it was…

Information Theory · Computer Science 2013-04-02 Mihailo Stojnic

High-dimensional planted problems, such as finding a hidden dense subgraph within a random graph, often exhibit a gap between statistical and computational feasibility. While recovering the hidden structure may be statistically possible, it…

Statistics Theory · Mathematics 2026-05-15 Youngtak Sohn , Alexander S. Wein

We are concerned with structured $\ell_0$-norms regularization problems, with a twice continuously differentiable loss function and a box constraint. This class of problems have a wide range of applications in statistics, machine learning…

Optimization and Control · Mathematics 2023-12-27 Yuqia Wu , Shaohua Pan , Xiaoqi Yang

The most widely used form of convolutional sparse coding uses an $\ell_1$ regularization term. While this approach has been successful in a variety of applications, a limitation of the $\ell_1$ penalty is that it is homogeneous across the…

Computer Vision and Pattern Recognition · Computer Science 2017-11-09 Brendt Wohlberg