English
Related papers

Related papers: Algorithms for envelope estimation

200 papers

We develop an envelope model for joint mean and covariance regression in the large $p$, small $n$ setting. In contrast to existing envelope methods, which improve mean estimates by incorporating estimates of the covariance structure, we…

Methodology · Statistics 2020-10-02 Alexander Franks

The last decade has witnessed an explosion in the development of models, theory and computational algorithms for "big data" analysis. In particular, distributed computing has served as a natural and dominating paradigm for statistical…

Machine Learning · Statistics 2018-11-02 Bayan Saparbayeva , Michael Minyi Zhang , Lizhen Lin

The response envelope model provides substantial efficiency gains over the standard multivariate linear regression by identifying the material part of the response to the model and by excluding the immaterial part. In this paper, we propose…

Methodology · Statistics 2024-07-02 Oh-Ran Kwon , Hui Zou

Envelope methods improve the estimation efficiency in multivariate linear regression by identifying and separating the material and immaterial parts of the responses or the predictors and estimating the regression coefficients using only…

Methodology · Statistics 2025-09-10 Tate Jacobson

We develop algorithms for sampling from a probability distribution on a submanifold embedded in Rn. Applications are given to the evaluation of algorithms in 'Topological Statistics'; to goodness of fit tests in exponential families and to…

Statistics Theory · Mathematics 2012-07-06 Persi Diaconis , Susan Holmes , Mehrdad Shahshahani

We propose a robust and scalable procedure for general optimization and inference problems on manifolds leveraging the classical idea of `median-of-means' estimation. This is motivated by ubiquitous examples and applications in modern data…

Methodology · Statistics 2020-06-16 Lizhen Lin , Drew Lazar , Bayan Sarpabayeva , David B. Dunson

In this paper, we propose a unified algorithmic framework for solving many known variants of \mds. Our algorithm is a simple iterative scheme with guaranteed convergence, and is \emph{modular}; by changing the internals of a single…

Machine Learning · Computer Science 2010-03-31 Arvind Agarwal , Jeff M. Phillips , Suresh Venkatasubramanian

Dimension reduction is an important tool for analyzing high-dimensional data. The predictor envelope is a method of dimension reduction for regression that assumes certain linear combinations of the predictors are immaterial to the…

Methodology · Statistics 2022-01-07 Paul May , Hossein Moradi Rekabdarkolaee

We describe a framework in which is possible to develop and implement algorithms for the approximation of invariant measures of dynamical systems with a given bound on the error of the approximation. Our approach is based on a general…

Dynamical Systems · Mathematics 2017-10-05 Stefano Galatolo , Isaia Nisoli

Consensus algorithms are popular distributed algorithms for computing aggregate quantities, such as averages, in ad-hoc wireless networks. However, existing algorithms mostly address the case where the measurements lie in a Euclidean space.…

Dynamical Systems · Mathematics 2012-02-02 Roberto Tron , Bijan Afsari , René Vidal

In the present paper, we propose and analyze a novel method for estimating a univariate regression function of bounded variation. The underpinning idea is to combine two classical tools in nonparametric statistics, namely isotonic…

Statistics Theory · Mathematics 2012-11-20 Arnaud Guyader , Nicolas Jégou , Alexander B. Németh , Sándor Z. Németh

Variance parameter estimation in linear mixed models is a challenge for many classical nonlinear optimization algorithms due to the positive-definiteness constraint of the random effects covariance matrix. We take a completely novel view on…

Machine Learning · Statistics 2022-12-20 Lena Sembach , Jan Pablo Burgard , Volker H. Schulz

Envelope methods perform dimension reduction of predictors or responses in multivariate regression, exploiting the relationship between them to improve estimation efficiency. While most research on envelopes has focused on their estimation…

Methodology · Statistics 2025-01-22 Tate Jacobson , Oh-Ran Kwon

A weighted likelihood technique for robust estimation of a multivariate Wrapped Normal distribution for data points scattered on a p-dimensional torus is proposed. The occurrence of outliers in the sample at hand can badly compromise…

Methodology · Statistics 2021-07-01 Giovanni Saraceno , Claudio Agostinelli , Luca Greco

We present an analytical-numerical method providing robust upper estimates for the topological entropy or, more generally, uniform volume growth exponents of differentiable mappings. By introducing varying metrics, we simplify the analysis…

Dynamical Systems · Mathematics 2025-03-17 Mikhail Anikushin , Andrey Romanov

Suppose that we wish to estimate a finite-dimensional summary of one or more function-valued features of an underlying data-generating mechanism under a nonparametric model. One approach to estimation is by plugging in flexible estimates of…

Methodology · Statistics 2020-08-28 Hongxiang Qiu , Alex Luedtke , Marco Carone

Under a partially linear models we study a family of robust estimates for the regression parameter and the regression function when some of the predictor variables take values on a Riemannian manifold. We obtain the consistency and the…

Statistics Theory · Mathematics 2011-05-26 Guillermo Henry , Daniela Rodriguez

Learning on Grassmann manifold has become popular in many computer vision tasks, with the strong capability to extract discriminative information for imagesets and videos. However, such learning algorithms particularly on high-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2017-04-28 Boyue Wang , Yongli Hu , Junbin Gao , Yanfeng Sun , Haoran Chen , Baocai Yin

We consider the regression problem of estimating functions on $\mathbb{R}^D$ but supported on a $d$-dimensional manifold $ \mathcal{M} \subset \mathbb{R}^D $ with $ d \ll D $. Drawing ideas from multi-resolution analysis and nonlinear…

Machine Learning · Statistics 2021-01-14 Wenjing Liao , Mauro Maggioni , Stefano Vigogna

We consider the problem of density estimation on Riemannian manifolds. Density estimation on manifolds has many applications in fluid-mechanics, optics and plasma physics and it appears often when dealing with angular variables (such as…

Machine Learning · Statistics 2016-11-10 Mevlana C. Gemici , Danilo Rezende , Shakir Mohamed