English
Related papers

Related papers: Estimating multi-index models with response-condit…

200 papers

Subset selection for multiple linear regression aims to construct a regression model that minimizes errors by selecting a small number of explanatory variables. Once a model is built, various statistical tests and diagnostics are conducted…

Machine Learning · Statistics 2020-09-04 Seokhyun Chung , Young Woong Park , Taesu Cheong

This paper studies the problem of estimating a large coefficient matrix in a multiple response linear regression model when the coefficient matrix could be both of low rank and sparse in the sense that most nonzero entries concentrate on a…

Methodology · Statistics 2016-03-18 Zhuang Ma , Zongming Ma , Tingni Sun

In this paper, we investigate the matrix estimation problem in the multi-response regression model with measurement errors. A nonconvex error-corrected estimator based on a combination of the amended loss function and the nuclear norm…

Statistics Theory · Mathematics 2022-09-19 Xin Li , Dongya Wu

We mainly study the M-estimation method for the high-dimensional linear regression model, and discuss the properties of M-estimator when the penalty term is the local linear approximation. In fact, M-estimation method is a framework, which…

Probability · Mathematics 2018-10-31 Kai Wang , Yanling Zhu

In this article, we propose two classes of semiparametric mixture regression models with single-index for model based clustering. Unlike many semiparametric/nonparametric mixture regression models that can only be applied to low dimensional…

Methodology · Statistics 2017-08-15 Sijia Xiang , Weixin Yao

This paper introduces a novel framework for estimation and inference in penalized M-estimators applied to robust high-dimensional linear regression models. Traditional methods for high-dimensional statistical inference, which predominantly…

Methodology · Statistics 2025-04-15 Dian Zheng , Lingzhou Xue

We develop estimation and inference methods for a stylized macroeconomic model with potentially multiple behavioural equilibria, where agents form expectations using a constant-gain learning rule. We first show geometric ergodicity of the…

Econometrics · Economics 2026-03-10 Alexander Mayer , Davide Raggi

Nonparametric methods have been very popular in the last couple of decades in time series and regression, but no such development has taken place for spatial models. A rather obvious reason for this is the curse of dimensionality. For…

Statistics Theory · Mathematics 2007-06-13 Jiti Gao , Zudi Lu , Dag Tjøstheim

The task of approximating a function of d variables from its evaluations at a given number of points is ubiquitous in numerical analysis and engineering applications. When d is large, this task is challenged by the so-called curse of…

Numerical Analysis · Mathematics 2016-12-21 Albert Cohen , Giovanni Migliorati

We develop a projected least squares estimator for the change point parameter in a high dimensional time series model with a potential change point. Importantly we work under the setup where the jump size may be near the boundary of the…

Statistics Theory · Mathematics 2019-09-19 Abhishek Kaul , Venkata K Jandhyala , Stergios B Fotopoulos

Multi-index models - functions which only depend on the covariates through a non-linear transformation of their projection on a subspace - are a useful benchmark for investigating feature learning with neural nets. This paper examines the…

Machine Learning · Computer Science 2025-11-13 Emanuele Troiani , Yatin Dandi , Leonardo Defilippis , Lenka Zdeborová , Bruno Loureiro , Florent Krzakala

In small area estimation different data sources are integrated in order to produce reliable estimates of target parameters (e.g., a mean or a proportion) for a collection of small subsets (areas) of a finite population. Regression models…

Methodology · Statistics 2024-05-31 Enrico Fabrizi , Nicola Salvati , Martin Slawski

This paper presents a computationally feasible method to compute rigorous bounds on the interval-generalisation of regression analysis to account for epistemic uncertainty in the output variables. The new iterative method uses machine…

Data Analysis, Statistics and Probability · Physics 2023-02-22 Krasymyr Tretiak , Georg Schollmeyer , Scott Ferson

Linear mixed-effects models are widely used in analyzing clustered or repeated measures data. We propose a quasi-likelihood approach for estimation and inference of the unknown parameters in linear mixed-effects models with high-dimensional…

Methodology · Statistics 2021-03-10 Sai Li , Tony T. Cai , Hongzhe Li

Inspired by the complexity of certain real-world datasets, this article introduces a novel flexible linear spline index regression model. The model posits piecewise linear effects of an index on the response, with continuous changes…

Methodology · Statistics 2024-09-04 Lianqiang Qu , Long Lv , Meiling Hao , Liuquan Sun

Diffusion models achieve state-of-the-art performance in various generation tasks. However, their theoretical foundations fall far behind. This paper studies score approximation, estimation, and distribution recovery of diffusion models,…

Machine Learning · Computer Science 2023-02-15 Minshuo Chen , Kaixuan Huang , Tuo Zhao , Mengdi Wang

An efficient method is described to handle mesh indexes in multidimensional problems like numerical integration of partial differential equations, lattice model simulations, and determination of atomic neighbor lists. By creating an…

Materials Science · Physics 2015-06-24 Jose M. Soler

Subsampling methods have been recently proposed to speed up least squares estimation in large scale settings. However, these algorithms are typically not robust to outliers or corruptions in the observed covariates. The concept of influence…

Machine Learning · Statistics 2014-06-20 Brian McWilliams , Gabriel Krummenacher , Mario Lucic , Joachim M. Buhmann

This paper presents a significant advancement in the estimation of the Composite Link Model within a penalized likelihood framework, specifically designed to address indirect observations of grouped count data. While the model is effective…

Methodology · Statistics 2025-12-16 Carlo G. Camarda , María Durbán

The increasing popularity of regression discontinuity methods for causal inference in observational studies has led to a proliferation of different estimating strategies, most of which involve first fitting non-parametric regression models…

Methodology · Statistics 2018-06-11 Guido Imbens , Stefan Wager