English
Related papers

Related papers: Random linear systems with sparse solutions -- fin…

200 papers

Solving under-determined systems of linear equations with sparse solutions attracted enormous amount of attention in recent years, above all, due to work of \cite{CRT,CanRomTao06,DonohoPol}. In \cite{CRT,CanRomTao06,DonohoPol} it was…

Information Theory · Computer Science 2013-04-02 Mihailo Stojnic

This work aims to prove the small time large deviation principle (LDP) for a class of stochastic partial differential equations (SPDEs) with locally monotone coefficients in generalized variational framework. The main result could be…

Probability · Mathematics 2021-02-23 Shihu Li , Wei Liu , Yingchao Xie

This work provides new results for the analysis of random sequences in terms of $\ell_p$-compressibility. The results characterize the degree in which a random sequence can be approximated by its best $k$-sparse version under different…

Methodology · Statistics 2021-07-09 Jorge F. Silva

In this paper we continue our earlier investigations into the asymptotic behaviour of infinite systems of coupled differential equations. Under the mild assumption that the so-called characteristic function of our system is completely…

Functional Analysis · Mathematics 2020-10-01 Lassi Paunonen , David Seifert

We continue the development, started in of the asymptotic description of certain stochastic neural networks. We use the Large Deviation Principle (LDP) and the good rate function H announced there to prove that H has a unique minimum mu_e,…

Probability · Mathematics 2014-07-10 Olivier Faugeras , James MacLaurin

We investigate the late-time asymptotic behavior of solutions to nonlinear hyperbolic systems of conservation laws containing stiff relaxation terms. First, we introduce a Chapman-Enskog-type asymptotic expansion and derive an effective…

Analysis of PDEs · Mathematics 2011-09-20 Christophe Berthon , Philippe G. LeFloch , Rodolphe Turpault

This paper is concerned with investigating the asymptotic behavior of the gradients of solutions to a class of elliptic systems with general boundary data, especially covering the Lam\'{e} systems, in a narrow region. The novelty of this…

Analysis of PDEs · Mathematics 2022-04-15 Zhiwen Zhao

Consider the projection of an $n$-dimensional random vector onto a random $k_n$-dimensional basis, $k_n \leq n$, drawn uniformly from the Haar measure on the Stiefel manifold of orthonormal $k_n$-frames in $\mathbb{R}^n$, in three different…

Probability · Mathematics 2021-10-28 Steven Soojin Kim , Yin-Ting Liao , Kavita Ramanan

In this paper we look at a well known linear inverse problem that is one of the mathematical cornerstones of the compressed sensing field. In seminal works \cite{CRT,DOnoho06CS} $\ell_1$ optimization and its success when used for recovering…

Information Theory · Computer Science 2015-07-17 Mihailo Stojnic

In this work we determine a process-level Large Deviation Principle (LDP) for a model of interacting particles indexed by a lattice $\mathbb{Z}^d$. The connections are random, sparse and unscaled, so that the system converges in the large…

Probability · Mathematics 2024-10-01 James MacLaurin

Nonparametric estimation of the mean and covariance functions is ubiquitous in functional data analysis and local linear smoothing techniques are most frequently used. Zhang and Wang (2016) explored different types of asymptotic properties…

Statistics Theory · Mathematics 2025-01-28 Shaojun Guo , Dong Li , Xinghao Qiao , Yizhu Wang

We study asymptotic behaviour of stochastic approximation procedures with three main characteristics: truncations with random moving bounds, a matrix valued random step-size sequence, and a dynamically changing random regression function.…

Statistics Theory · Mathematics 2016-11-22 Teo Sharia , Lei Zhong

In experiments, the dynamical behavior of systems is reflected in time series. Due to the finiteness of the observational data set it is not possible to reconstruct the invariant measure up to arbitrary fine resolution and arbitrary high…

Chaotic Dynamics · Physics 2009-10-31 M. Cencini , M. Falcioni , H. Kantz , E. Olbrich , A. Vulpiani

We study the asymptotic behavior, uniform-in-time, of a non-linear dynamical system under the combined effects of fast periodic sampling with period $\delta$ and small white noise of size $\varepsilon,\thinspace 0<\varepsilon,\delta \ll 1$.…

Probability · Mathematics 2025-02-18 Shivam Singh Dhama , Konstantinos Spiliopoulos

In our recent work \cite{StojnicCSetam09} we considered solving under-determined systems of linear equations with sparse solutions. In a large dimensional and statistical context we proved that if the number of equations in the system is…

Information Theory · Computer Science 2013-04-01 Mihailo Stojnic

Linear Dynamical System (LDS) is an elegant mathematical framework for modeling and learning multivariate time series. However, in general, it is difficult to set the dimension of its hidden state space. A small number of hidden states may…

Artificial Intelligence · Computer Science 2013-12-04 Zitao Liu , Milos Hauskrecht

Transfer learning techniques aim to leverage information from multiple related datasets to enhance prediction quality against a target dataset. Such methods have been adopted in the context of high-dimensional sparse regression, and some…

Machine Learning · Statistics 2025-01-31 Koki Okajima , Tomoyuki Obuchi

In sparse linear regression, the SLOPE estimator generalizes LASSO by penalizing different coordinates of the estimate according to their magnitudes. In this paper, we present a precise performance characterization of SLOPE in the…

Information Theory · Computer Science 2021-06-07 Hong Hu , Yue M. Lu

In our recent work \cite{StojnicCSetam09,StojnicUpper10} we considered solving under-determined systems of linear equations with sparse solutions. In a large dimensional and statistical context we proved results related to performance of a…

Information Theory · Computer Science 2013-04-02 Mihailo Stojnic

The incidence of rare events in fast-slow systems is investigated via analysis of the large deviation principle (LDP) that characterizes the likelihood and pathway of large fluctuations of the slow variables away from their mean behavior --…

Statistical Mechanics · Physics 2016-02-17 Freddy Bouchet , Tobias Grafke , Tomás Tangarife , Eric Vanden-Eijnden