English
Related papers

Related papers: On the Optimality of Functional Sliced Inverse Reg…

200 papers

We consider the nonparametric estimation of an S-shaped regression function. The least squares estimator provides a very natural, tuning-free approach, but results in a non-convex optimisation problem, since the inflection point is unknown.…

Methodology · Statistics 2024-12-17 Oliver Y. Feng , Yining Chen , Qiyang Han , Raymond J. Carroll , Richard J. Samworth

We consider the problem of approximating a truncated Gaussian kernel using Fourier (trigonometric) functions. The computation-intensive bilateral filter can be expressed using fast convolutions by applying such an approximation to its range…

Image and Video Processing · Electrical Eng. & Systems 2018-11-07 Sanjay Ghosh , Pravin Nair , Kunal N. Chaudhury

We present a framework for performing efficient regression in general metric spaces. Roughly speaking, our regressor predicts the value at a new point by computing a Lipschitz extension --- the smoothest function consistent with the…

Machine Learning · Computer Science 2017-04-25 Lee-Ad Gottlieb , Aryeh Kontorovich , Robert Krauthgamer

We quantify the minimax rate for a nonparametric regression model over a star-shaped function class $\mathcal{F}$ with bounded diameter. We obtain a minimax rate of ${\varepsilon^{\ast}}^2\wedge\mathrm{diam}(\mathcal{F})^2$ where…

Statistics Theory · Mathematics 2025-08-20 Akshay Prasadan , Matey Neykov

We consider the problem of estimating the slope function in a functional regression with a scalar response and a functional covariate. This central problem of functional data analysis is well known to be ill-posed, thus requiring a…

Methodology · Statistics 2016-10-05 Anirvan Chakraborty , Victor M. Panaretos

We delve into the estimation of the functional coefficients and inference for varying coefficient model. Applying Laguerre series, we develop an estimator for the vector of functional coefficients that attains asymptotically optimal…

Statistics Theory · Mathematics 2026-05-04 Rida Benhaddou , Khalid Chokri , Jackson Pinschenat

Supervised dimension reduction for time series is challenging as there may be temporal dependence between the response $y$ and the predictors $\boldsymbol x$. Recently a time series version of sliced inverse regression, TSIR, was suggested,…

Methodology · Statistics 2019-05-07 Markus Matilainen , Christophe Croux , Klaus Nordhausen , Hannu Oja

We obtain minimax-optimal convergence rates in the supremum norm, including information-theoretic lower bounds, for estimating the covariance kernel of a stochastic process which is repeatedly observed at discrete, synchronous design…

Statistics Theory · Mathematics 2025-09-03 Max Berger , Hajo Holzmann

Statistical inferences for quadratic functionals of linear regression parameter have found wide applications including signal detection, global testing, inferences of error variance and fraction of variance explained. Classical theory based…

Statistics Theory · Mathematics 2020-06-17 Xiao Guo , Guang Cheng

This paper studies a regression model where both predictor and response variables are random functions. We consider a functional linear model where the conditional mean of the response variable at each time point is given by a linear…

Statistics Theory · Mathematics 2017-03-23 Masaaki Imaizumi , Kengo Kato

In this paper we present a fast and efficient method for the reconstruction of Magnetic Resonance Images (MRI) from severely under-sampled data. From the Compressed Sensing theory we have mathematically modeled the problem as a constrained…

Numerical Analysis · Computer Science 2017-12-01 Damiana Lazzaro , Elena Loli Piccolomini , Fabiana Zama

In this paper, we study the estimation and inference of change points under a functional linear regression model with changes in the slope function. We present a novel Functional Regression Binary Segmentation (FRBS) algorithm which is…

Methodology · Statistics 2026-02-02 Shivam Kumar , Haotian Xu , Haeran Cho , Daren Wang

Image registration is an ill-posed dense vision task, where multiple solutions achieve similar loss values, motivating probabilistic inference. Variational inference has previously been employed to capture these distributions, however…

Image and Video Processing · Electrical Eng. & Systems 2026-03-19 Ivor J. A. Simpson , Neill D. F. Campbell

Many economic parameters are identified by ``thin sets'' (submanifolds with Lebesgue measure zero) and hence difficult to recover from data in an ambient space. This paper provides a unified theory for estimation and inference of such…

Econometrics · Economics 2026-03-09 Xiaohong Chen , Wayne Yuan Gao

We present a forward sufficient dimension reduction method for categorical or ordinal responses by extending the outer product of gradients and minimum average variance estimator to multinomial generalized linear model. Previous work in…

Methodology · Statistics 2023-03-30 Harris Quach , Bing Li

We investigate the application of sufficient dimension reduction (SDR) to a noiseless data set derived from a deterministic function of several variables. In this context, SDR provides a framework for ridge recovery. In this second part, we…

Numerical Analysis · Mathematics 2018-08-10 Andrew Glaws , Paul G. Constantine , R. Dennis Cook

The inverse Ising problem seeks to reconstruct the parameters of an Ising Hamiltonian on the basis of spin configurations sampled from the Boltzmann measure. Over the last decade, many applications of the inverse Ising problem have arisen,…

Disordered Systems and Neural Networks · Physics 2017-09-13 Johannes Berg

Statistical modeling often involves identifying an optimal estimate to some underlying probability distribution known to satisfy some given constraints. I show here that choosing as estimate the centroid, or center of mass, of the set…

Methodology · Statistics 2013-10-11 Jonathan Landy

We provide a convergence analysis of deep feature instrumental variable (DFIV) regression (Xu et al., 2021), a nonparametric approach to IV regression using data-adaptive features learned by deep neural networks in two stages. We prove that…

Machine Learning · Statistics 2025-01-10 Juno Kim , Dimitri Meunier , Arthur Gretton , Taiji Suzuki , Zhu Li

Nowadays, massive datasets are typically dispersed across multiple locations, encountering dual challenges of high dimensionality and huge sample size. Therefore, it is necessary to explore sufficient dimension reduction (SDR) methods for…

Methodology · Statistics 2025-09-16 Hongying Li , Minyi Zhu , Yaqi Cao , Xinyi Xu