English
Related papers

Related papers: Ratio-consistent estimation for long range depende…

200 papers

Estimation of signal-to-noise ratios and residual variances in high-dimensional linear models has various important applications including, e.g. heritability estimation in bioinformatics. One commonly used estimator, usually referred to as…

Statistics Theory · Mathematics 2023-06-09 Xiaohan Hu , Xiaodong Li

This paper tackles the problem of Lipschitz regularization of Convolutional Neural Networks. Lipschitz regularity is now established as a key property of modern deep learning with implications in training stability, generalization,…

Machine Learning · Computer Science 2020-11-10 Alexandre Araujo , Benjamin Negrevergne , Yann Chevaleyre , Jamal Atif

Multivariate processes with long-range dependent properties are found in a large number of applications including finance, geophysics and neuroscience. For real data applications, the correlation between time series is crucial. Usual…

Statistics Theory · Mathematics 2015-11-02 Sophie Achard , Irène Gannaz

Large scale image classification datasets often contain noisy labels. We take a principled probabilistic approach to modelling input-dependent, also known as heteroscedastic, label noise in these datasets. We place a multivariate Normal…

Machine Learning · Computer Science 2021-05-24 Mark Collier , Basil Mustafa , Efi Kokiopoulou , Rodolphe Jenatton , Jesse Berent

This paper investigates the classical statistical signal processing problem of detecting a signal in the presence of colored noise with an unknown covariance matrix. In particular, we consider a scenario where m-dimensional p possible…

Information Theory · Computer Science 2019-01-29 Lahiru D. Chamain , Prathapasinghe Dharmawansa , Saman Atapattu , Chintha Tellambura

Consider semiparametric estimation where a doubly robust estimating function for a low-dimensional parameter is available, depending on two working models. With high-dimensional data, we develop regularized calibrated estimation as a…

Methodology · Statistics 2020-09-28 Satyajit Ghosh , Zhiqiang Tan

We study the algorithmic problem of robust mean estimation of an identity covariance Gaussian in the presence of mean-shift contamination. In this contamination model, we are given a set of points in $\mathbb{R}^d$ generated i.i.d. via the…

Data Structures and Algorithms · Computer Science 2025-02-21 Ilias Diakonikolas , Giannis Iakovidis , Daniel M. Kane , Thanasis Pittas

This paper studies the high-dimensional mixed linear regression (MLR) where the output variable comes from one of the two linear regression models with an unknown mixing proportion and an unknown covariance structure of the random…

Methodology · Statistics 2020-11-10 Linjun Zhang , Rong Ma , T. Tony Cai , Hongzhe Li

Under a multinormal distribution with an arbitrary unknown covariance matrix, the main purpose of this paper is to propose a framework to achieve the goal of reconciliation of Bayesian, frequentist, and Fisher's reporting $p$-values,…

Statistics Theory · Mathematics 2024-12-10 Ming-Tien Tsai

Standard noise radars, as well as noise-type radars such as quantum two-mode squeezing radar, are characterized by a covariance matrix with a very specific structure. This matrix has four independent parameters: the amplitude of the…

Signal Processing · Electrical Eng. & Systems 2022-08-10 David Luong , Bhashyam Balaji , Sreeraman Rajan

In this paper we study covariance estimation with missing data. We consider missing data mechanisms that can be independent of the data, or have a time varying dependency. Additionally, observed variables may have arbitrary (non uniform)…

Statistics Theory · Mathematics 2021-06-17 Eduardo Pavez , Antonio Ortega

The reduced-rank regression model is a popular model to deal with multivariate response and multiple predictors, and is widely used in biology, chemometrics, econometrics, engineering, and other fields. In the reduced-rank regression…

Methodology · Statistics 2022-07-05 Canhong Wen , Qin Wang , Yuan Jiang

This paper studies the multi-task high-dimensional linear regression models where the noise among different tasks is correlated, in the moderately high dimensional regime where sample size $n$ and dimension $p$ are of the same order. Our…

Statistics Theory · Mathematics 2022-06-16 Kai Tan , Gabriel Romon , Pierre C Bellec

There is a great need for robust techniques in data mining and machine learning contexts where many standard techniques such as principal component analysis and linear discriminant analysis are inherently susceptible to outliers.…

Methodology · Statistics 2015-09-28 Garth Tarr , Samuel Müller , Neville C. Weber

Testing for white noise is a classical yet important problem in statistics, especially for diagnostic checks in time series modeling and linear regression. For high-dimensional time series in the sense that the dimension $p$ is large in…

Statistics Theory · Mathematics 2018-11-26 Zeng Li , Clifford Lam , Jianfeng Yao , Qiwei Yao

One of the major challenges in multivariate analysis is the estimation of population covariance matrix from sample covariance matrix (SCM). Most recent covariance matrix estimators use either shrinkage transformations or asymptotic results…

Methodology · Statistics 2019-12-10 Samruddhi Deshmukh , Amartansh Dubey

The RTS smoother is widely used for state estimation and it is utilized here to increase the data quality with respect to physical coherence and to increase resolution. The purpose of this paper is to enhance the performance of the RTS…

Applications · Statistics 2022-06-22 Lukas Höhndorf , Thomas Nagler , Phillip Koppitz , Claudia Czado , Florian Holzapfel

This paper investigates the signal detection problem in colored noise with an unknown covariance matrix. In particular, we focus on detecting a non-random signal by capitalizing on the leading eigenvalue (a.k.a. Roy's largest root) of the…

Signal Processing · Electrical Eng. & Systems 2024-12-10 Prathapasinghe Dharmawansa , Saman Atapattu , Jamie Evans , Merouane Debbah

Regularization is a core component of modern inverse problems, as it helps establish the well-posedness of the solution of interest. Popular regularization approaches include variational regularization and iterative regularization. The…

Optimization and Control · Mathematics 2025-08-08 Jie Gao , Cesare Molinari , Silvia Villa , Jingwei Liang

Low-rank multivariate regression (LRMR) is an important statistical learning model that combines highly correlated tasks as a multiresponse regression problem with low-rank priori on the coefficient matrix. In this paper, we study quantized…

Machine Learning · Statistics 2023-10-10 Junren Chen , Yueqi Wang , Michael K. Ng