English
Related papers

Related papers: Generalized robust shrinkage estimator and its app…

200 papers

The Fokker-Planck equations (FPEs) for stochastic systems driven by additive symmetric $\alpha$-stable noises may not adequately describe the time evolution for the probability densities of solution paths in some practical applications,…

Dynamical Systems · Mathematics 2020-03-11 Yanjie Zhang , Xiao Wang , Qiao Huang , Jinqiao Duan , Tingting Li

We develop a Nonparametric Empirical Bayes (NEB) framework for compound estimation in the discrete linear exponential family, which includes a wide class of discrete distributions frequently arising from modern big data applications. We…

Statistics Theory · Mathematics 2024-10-24 Trambak Banerjee , Qiang Liu , Gourab Mukherjee , Wenguang Sun

Score matching estimators have gained widespread attention in recent years partly because they are free from calculating the integral of normalizing constant, thereby addressing the computational challenges in maximum likelihood estimation…

Machine Learning · Statistics 2024-10-08 Haoqun Cao , Zizhuo Meng , Tianjun Ke , Feng Zhou

Efficiently solving the Fokker-Planck equation (FPE) is crucial for understanding the probabilistic evolution of stochastic particles in dynamical systems, however, analytical solutions or density functions are only attainable in specific…

Computational Physics · Physics 2025-03-13 Xiaolong Wang , Jing Feng , Gege Wang , Tong Li , Yong Xu

We consider the problem of simultaneous variable selection and constant coefficient identification in high-dimensional varying coefficient models based on B-spline basis expansion. Both objectives can be considered as some type of model…

Methodology · Statistics 2010-08-16 Heng Lian

Space-time adaptive processing (STAP) is an effective tool for detecting a moving target in spaceborne or airborne radar systems. Statistical-based STAP methods generally need sufficient statistically independent and identically distributed…

Information Theory · Computer Science 2010-08-26 Ke Sun , Hao Zhang , Gang Li , Huadong Meng , Xiqin Wang

Most algorithms for solving optimization problems or finding saddle points of convex-concave functions are fixed-point algorithms. In this work we consider the generic problem of finding a fixed point of an average of operators, or an…

Machine Learning · Computer Science 2020-06-17 Grigory Malinovsky , Dmitry Kovalev , Elnur Gasanov , Laurent Condat , Peter Richtárik

The Sparse Generalized Eigenvalue Problem (sGEP), a pervasive challenge in statistical learning methods including sparse principal component analysis, sparse Fisher's discriminant analysis, and sparse canonical correlation analysis,…

Optimization and Control · Mathematics 2023-08-24 Qia Li , Jianmin Liao , Lixin Shen , Na Zhang

In this paper, the purpose is to introduce and study a new modified shrinking projection algorithm with inertial effects, which solves split common fixed point problems in Banach spaces. The corresponding strong convergence theorems are…

Optimization and Control · Mathematics 2020-08-31 Zheng Zhou , Bing Tan , Songxiao Li

The "fast iterative shrinkage-thresholding algorithm", a.k.a. FISTA, is one of the most well-known first-order optimisation scheme in the literature, as it achieves the worst-case $O(1/k^2)$ optimal convergence rate in terms of objective…

Optimization and Control · Mathematics 2021-01-21 Jingwei Liang , Tao Luo , Carola-Bibiane Schönlieb

In this work, we address the problem of Hessian inversion bias in distributed second-order optimization algorithms. We introduce a novel shrinkage-based estimator for the resolvent of gram matrices which is asymptotically unbiased, and…

Optimization and Control · Mathematics 2024-02-06 Fangzhao Zhang , Mert Pilanci

In this paper, we consider deep neural networks for solving inverse problems that are robust to forward model mis-specifications. Specifically, we treat sensing problems with model mismatch where one wishes to recover a sparse…

Machine Learning · Computer Science 2021-10-22 Wei Pu , Chao Zhou , Yonina C. Eldar , Miguel R. D. Rodrigues

Estimating the clutter-plus-noise covariance matrix in high-dimensional STAP is challenging in the presence of Internal Clutter Motion (ICM) and a high noise floor. The problem becomes more difficult in low-sample regimes, where the Sample…

Signal Processing · Electrical Eng. & Systems 2025-05-13 Shashwat Jain , Vikram Krishnamurthy , Muralidhar Rangaswamy , Sandeep Gogineni , Bosung Kang , Sean M. O'Rourke

In this study, we propose shrinkage methods based on {\it generalized ridge regression} (GRR) estimation which is suitable for both multicollinearity and high dimensional problems with small number of samples (large $p$, small $n$). Also,…

Statistics Theory · Mathematics 2020-03-04 Bahadır Yüzbaşı , Mohammad Arashi , S. Ejaz Ahmed

Multi-target linear shrinkage is an extension of the standard single-target linear shrinkage for covariance estimation. We combine several constant matrices - the targets - with the sample covariance matrix. We derive the oracle and a…

Statistics Theory · Mathematics 2025-03-13 Benoit Oriol

Robust principal component analysis is an important representative method in data analysis. It is usually viewed as an optimization problem involving the rank and $\ell_0$-norm of matrices. In this paper, we study the rank and $\ell_0$…

Optimization and Control · Mathematics 2026-03-04 Wenjing Li , Wei Bian , Kim-Chuan Toh

The accelerated proximal point algorithm (APPA), also known as "Catalyst", is a well-established reduction from convex optimization to approximate proximal point computation (i.e., regularized minimization). This reduction is conceptually…

Optimization and Control · Mathematics 2022-06-20 Yair Carmon , Arun Jambulapati , Yujia Jin , Aaron Sidford

We consider a Bayesian framework for estimating a high-dimensional sparse precision matrix, in which adaptive shrinkage and sparsity are induced by a mixture of Laplace priors. Besides discussing our formulation from the Bayesian…

Machine Learning · Statistics 2018-05-22 Lingrui Gan , Naveen N. Narisetty , Feng Liang

The statistical properties of estimator using covariance matrix for the account of point-to-point correlations due to systematic errors are analyzed. It is shown that the covariance matrix estimator (CME) is consistent for the realistic…

High Energy Physics - Experiment · Physics 2007-05-23 Alekhin Sergey

Sequential neural posterior estimation (SNPE) techniques have been recently proposed for dealing with simulation-based models with intractable likelihoods. Unlike approximate Bayesian computation, SNPE techniques learn the posterior from…

Machine Learning · Statistics 2025-01-17 Yifei Xiong , Xiliang Yang , Sanguo Zhang , Zhijian He