English
Related papers

Related papers: Asymptotics for sliced average variance estimation

200 papers

In this paper, we use the stochastic approximation method to estimate Sliced Average Variance Estimation (SAVE). This method is known for its efficiency in recursive estimation. Stochastic approximation is particularly effective for…

Statistics Theory · Mathematics 2024-06-25 Emmanuel De Dieu Nkou

Supervised dimension reduction for time series is challenging as there may be temporal dependence between the response $y$ and the predictors $\boldsymbol x$. Recently a time series version of sliced inverse regression, TSIR, was suggested,…

Methodology · Statistics 2019-05-07 Markus Matilainen , Christophe Croux , Klaus Nordhausen , Hannu Oja

For multiple index models, it has recently been shown that the sliced inverse regression (SIR) is consistent for estimating the sufficient dimension reduction (SDR) space if and only if $\rho=\lim\frac{p}{n}=0$, where $p$ is the dimension…

Statistics Theory · Mathematics 2018-06-19 Qian Lin , Zhigen Zhao , Jun S. Liu

Sample average approximation (SAA) is a widely popular approach to data-driven decision-making under uncertainty. Under mild assumptions, SAA is both tractable and enjoys strong asymptotic performance guarantees. Similar guarantees,…

Optimization and Control · Mathematics 2016-11-03 Dimitris Bertsimas , Vishal Gupta , Nathan Kallus

Sliced Inverse Regression (SIR) is an effective method for dimension reduction in high-dimensional regression problems. The original method, however, requires the inversion of the predictors covariance matrix. In case of collinearity…

Statistics Theory · Mathematics 2011-04-01 C. Bernard-Michel , L. Gardes , S. Girard

We consider the problem of parameter estimation for a system of ordinary differential equations from noisy observations on a solution of the system. In case the system is nonlinear, as it typically is in practical applications, an analytic…

Statistics Theory · Mathematics 2012-07-27 Shota Gugushvili , Chris A. J. Klaassen

Compressive-sensing-based uncertainty quantification methods have become a pow- erful tool for problems with limited data. In this work, we use the sliced inverse regression (SIR) method to provide an initial guess for the alternating…

Numerical Analysis · Mathematics 2018-09-11 Xiu Yang , Weixuan Li , Alexandre Tartakovsky

It has previously been shown that ordinary least squares can be used to estimate the coefficients of the single-index model under only mild conditions. However, the estimator is non-robust leading to poor estimates for some models. In this…

Methodology · Statistics 2022-09-13 Marina Masioti , Joshua Davies , Amanda Shaker , Luke A. Prendergast

We provide here a framework to analyze the phase transition phenomenon of slice inverse regression (SIR), a supervised dimension reduction technique introduced by \cite{Li:1991}. Under mild conditions, the asymptotic ratio $\rho= \lim p/n$…

Statistics Theory · Mathematics 2016-11-22 Qian Lin , Zhigen Zhao , Jun S. Liu

It is well known that if the power spectral density of a continuous time stationary stochastic process does not have a compact support, data sampled from that process at any uniform sampling rate leads to biased and inconsistent spectrum…

Statistics Theory · Mathematics 2010-06-09 Radhendushka Srivastava , Debasis Sengupta

We prove that the convex least squares estimator (LSE) attains a $n^{-1/2}$ pointwise rate of convergence in any region where the truth is linear. In addition, the asymptotic distribution can be characterized by a modified invelope process.…

Statistics Theory · Mathematics 2018-01-30 Yining Chen , Jon A. Wellner

In this paper, we analyse the consistency of the Simplified Refined Instrumental Variable method for Continuous-time systems (SRIVC). It is well known that the intersample behaviour of the input signal influences the quality and accuracy of…

Systems and Control · Electrical Eng. & Systems 2019-10-02 Siqi Pan , Rodrigo A. González , James S. Welsh , Cristian R. Rojas

The drift sequential parameter estimation problems for the Cox-Ingersoll-Ross (CIR) processes under the limited duration of observation are studied. Truncated sequential estimation methods for both scalar and {two}-dimensional parameter…

Statistics Theory · Mathematics 2025-04-08 Mohamed Ben Alaya , Thi-Bao Trâm Ngô , Serguei Pergamenchtchikov

In this work, we study the problem of distributed mean estimation with $1$-bit communication constraints when the variance is unknown. We focus on the specific case where each user has access to one i.i.d. sample drawn from a distribution…

Information Theory · Computer Science 2025-10-10 Ritesh Kumar , Shashank Vatedka

We investigate the application of sufficient dimension reduction (SDR) to a noiseless data set derived from a deterministic function of several variables. In this context, SDR provides a framework for ridge recovery. In this second part, we…

Numerical Analysis · Mathematics 2018-08-10 Andrew Glaws , Paul G. Constantine , R. Dennis Cook

The idea of slicing divergences has been proven to be successful when comparing two probability measures in various machine learning applications including generative modeling, and consists in computing the expected value of a `base…

Machine Learning · Statistics 2022-01-05 Kimia Nadjahi , Alain Durmus , Lénaïc Chizat , Soheil Kolouri , Shahin Shahrampour , Umut Şimşekli

Sliced inverse regression (SIR) is a popular sufficient dimension reduction method that identifies a few linear transformations of the covariates without losing regression information with the response. In high-dimensional settings, SIR can…

Methodology · Statistics 2025-12-04 Linh H. Nghiem , Francis. K. C. Hui , Samuel Muller , A. H. Welsh

This paper introduces a popular dimension reduction method, sliced inverse regression (SIR), into multivariate statistical process monitoring. Provides an extension of SIR for the single-index model by adopting the idea from partial least…

Applications · Statistics 2012-02-03 Yue Yu , Zhijie Sun

Propensity score (PS) methods are widely used to estimate treatment effects in non-randomized studies. Variance is typically estimated using sandwich or bootstrap methods, which can either treat the PS as estimated or fixed. The latter is…

Methodology · Statistics 2025-11-17 Baoshan Zhang , Sean M. O'Brien , Yuan Wu , Laine E. Thomas

As they have a vital effect on social decision makings, AI algorithms should be not only accurate and but also fair. Among various algorithms for fairness AI, learning a prediction model by minimizing the empirical risk (e.g.,…

Machine Learning · Statistics 2025-05-26 Kunwoong Kim , Ilsang Ohn , Sara Kim , Yongdai Kim
‹ Prev 1 2 3 10 Next ›