English
Related papers

Related papers: Phase transition and higher order analysis of $L_q…

200 papers

In Bayesian statistics, horseshoe prior has attracted increasing attention as an approach to the sparse estimation. The estimation accuracy of compressed sensing with the horseshoe prior is evaluated by statistical mechanical method. It is…

Disordered Systems and Neural Networks · Physics 2023-03-29 Yasushi Nagano , Koji Hukushima

A nonnegative latent factorization of tensors (NLFT) model can well model the temporal pattern hidden in nonnegative quality-of-service (QoS) data for predicting the unobserved ones with high accuracy. However, existing NLFT models'…

Machine Learning · Computer Science 2022-08-20 Zemiao Peng , Hao Wu

A fundamental problem in machine learning is understanding the effect of early stopping on the parameters obtained and the generalization capabilities of the model. Even for linear models, the effect is not fully understood for arbitrary…

Machine Learning · Computer Science 2024-06-10 Rishi Sonthalia , Jackie Lok , Elizaveta Rebrova

We study a family of sparse estimators defined as minimizers of some empirical Lipschitz loss function -- which include the hinge loss, the logistic loss and the quantile regression loss -- with a convex, sparse or group-sparse…

Machine Learning · Statistics 2021-09-23 Antoine Dedieu

Multi-reference alignment entails estimating a signal in $\mathbb{R}^L$ from its circularly-shifted and noisy copies. This problem has been studied thoroughly in recent years, focusing on the finite-dimensional setting (fixed $L$).…

Information Theory · Computer Science 2021-10-01 Elad Romanov , Tamir Bendory , Or Ordentlich

A state-of-the-art strategy for digitally representing a bandlimited signal $f$ is $\Sigma\Delta$ quantization. $\Sigma\Delta$ quantization schemes choose a bit sequence $(q_n)$ representing the samples $(y_n)$ of $f$ sequentially based on…

Information Theory · Computer Science 2026-05-19 Rohan Joy , Felix Krahmer , Alessandro Lupoli

We consider the classic stochastic linear quadratic regulator (LQR) problem under an infinite horizon average stage cost. By leveraging recent policy gradient methods from reinforcement learning, we obtain a first-order method that finds a…

Optimization and Control · Mathematics 2025-02-21 Caleb Ju , Georgios Kotsalis , Guanghui Lan

The minimax sample complexity of group distributionally robust optimization (GDRO) has been determined up to a $\log(K)$ factor, where $K$ is the number of groups. In this work, we venture beyond the minimax perspective via a novel notion…

Machine Learning · Computer Science 2025-02-03 Quan Nguyen , Nishant A. Mehta , Cristóbal Guzmán

We consider the problem of detecting signals in the rank-one signal-plus-noise data matrix models that generalize the spiked Wishart matrices. We show that the principal component analysis can be improved by pre-transforming the matrix…

Statistics Theory · Mathematics 2021-04-29 Ji Hyung Jung , Hye Won Chung , Ji Oon Lee

Order statistics of periodic, Gaussian noise with 1/f^{\alpha} power spectrum is investigated. Using simulations and phenomenological arguments, we find three scaling regimes for the average gap d_k=<x_k-x_{k+1}> between the k-th and…

Statistical Mechanics · Physics 2013-05-29 N. R. Moloney , K. Ozogany , Z. Racz

Phase estimation is a quantum algorithm for measuring the eigenvalues of a Hamiltonian. We propose and rigorously analyse a randomized phase estimation algorithm with two distinctive features. First, our algorithm has complexity independent…

Quantum Physics · Physics 2022-08-09 Kianna Wan , Mario Berta , Earl T. Campbell

We propose a new risk-constrained reformulation of the standard Linear Quadratic Regulator (LQR) problem. Our framework is motivated by the fact that the classical (risk-neutral) LQR controller, although optimal in expectation, might be…

Systems and Control · Electrical Eng. & Systems 2020-10-30 Anastasios Tsiamis , Dionysios S. Kalogerias , Luiz F. O. Chamon , Alejandro Ribeiro , George J. Pappas

We introduce Lindblad-like quantum tomography (L$\ell$QT) as a quantum characterization technique of time-correlated noise in quantum information processors. This approach enables the estimation of time-local master equations, including…

Quantum Physics · Physics 2025-06-17 Santiago Varona , Markus Müller , Alejandro Bermudez

In this paper, we are concerned with the stochastic process \begin{equation} \beta_{n}(q_{t},t)=\beta_{n}(t)=\frac{1}{\sqrt{n}}\sum_{j=1}^{n}\left\{G_{t,n}(Y(t))-G_{t}(Y_{j}(t))\right\} q_{t}(Y_{j}(t)), \tag{A} \end{equation} where for…

Methodology · Statistics 2014-05-23 Gane Samb Lo

Consider a two-class classification problem where we observe samples $(X_i, Y_i)$ for i = 1, ..., n, $X_i \in R^p$ and $Y_i$ in {0, 1}. Given $Y_i = k$, $X_i$ is assumed to follow a multivariate normal distribution with mean $\mu_k \in R^k$…

Statistics Theory · Mathematics 2023-02-23 Wanjie Wang , Jingjing Wu , Zhigang Yao

We consider the statistical inverse problem to recover $f$ from noisy measurements $Y = Tf + \sigma \xi$ where $\xi$ is Gaussian white noise and $T$ a compact operator between Hilbert spaces. Considering general reconstruction methods of…

Numerical Analysis · Mathematics 2026-05-10 Housen Li , Frank Werner

We revisit the problem of simultaneously testing the means of $n$ independent normal observations under sparsity. We take a Bayesian approach to this problem by introducing a scale-mixture prior known as the normal-beta prime (NBP) prior.…

Methodology · Statistics 2020-07-29 Ray Bai , Malay Ghosh

Consider estimating a structured signal $\mathbf{x}_0$ from linear, underdetermined and noisy measurements $\mathbf{y}=\mathbf{A}\mathbf{x}_0+\mathbf{z}$, via solving a variant of the lasso algorithm: $\hat{\mathbf{x}}=\arg\min_\mathbf{x}\{…

Optimization and Control · Mathematics 2014-01-28 Christos Thrampoulidis , Samet Oymak , Babak Hassibi

Given $n$ noisy samples with $p$ dimensions, where $n \ll p$, we show that the multi-step thresholding procedure based on the Lasso -- we call it the {\it Thresholded Lasso}, can accurately estimate a sparse vector $\beta \in \R^p$ in a…

Statistics Theory · Mathematics 2010-02-11 Shuheng Zhou

In many compressed sensing applications, linear programming (LP) has been used to reconstruct a sparse signal. When observation is noisy, the LP formulation is extended to allow an inequality constraint and the solution is dependent on a…

Information Theory · Computer Science 2010-12-27 Jun Zhang , Jun Wang , Guangwu Xu