English
Related papers

Related papers: Optimal Bias-Correction and Valid Inference in Hig…

200 papers

In this paper, we propose a random projection approach to estimate variance in kernel ridge regression. Our approach leads to a consistent estimator of the true variance, while being computationally more efficient. Our variance estimator is…

Statistics Theory · Mathematics 2018-09-18 Meimei Liu , Jean Honorio , Guang Cheng

Inspired by recent findings on the fractal geometry of language, we introduce Recursive INference Scaling (RINS) as a complementary, plug-in recipe for scaling inference time in language and multimodal systems. RINS is a particular form of…

Artificial Intelligence · Computer Science 2025-05-09 Ibrahim Alabdulmohsin , Xiaohua Zhai

Random feature (RF) has been widely used for node consistency in decentralized kernel ridge regression (KRR). Currently, the consistency is guaranteed by imposing constraints on coefficients of features, necessitating that the random…

Machine Learning · Computer Science 2024-09-23 Ruikai Yang , Fan He , Mingzhen He , Jie Yang , Xiaolin Huang

Best subset selection in linear regression is well known to be nonconvex and computationally challenging to solve, as the number of possible subsets grows rapidly with increasing dimensionality of the problem. As a result, finding the…

Machine Learning · Statistics 2025-04-01 Vikram Singh , Min Sun

Recently, adversarial imitation learning has shown a scalable reward acquisition method for inverse reinforcement learning (IRL) problems. However, estimated reward signals often become uncertain and fail to train a reliable statistical…

Machine Learning · Computer Science 2023-01-06 Dong-Sig Han , Hyunseo Kim , Hyundo Lee , Je-Hwan Ryu , Byoung-Tak Zhang

Modern empirical work in Regression Discontinuity (RD) designs often employs local polynomial estimation and inference with a mean square error (MSE) optimal bandwidth choice. This bandwidth yields an MSE-optimal RD treatment effect…

Econometrics · Economics 2020-07-21 Sebastian Calonico , Matias D. Cattaneo , Max H. Farrell

It is well known that kernel ridge regression (KRR) is a popular nonparametric regression estimator. Nonetheless, in the presence of a large data set with size $n\gg 1,$ the KRR estimator has the drawback to require an intensive…

Statistics Theory · Mathematics 2023-01-19 Asma Ben Saber , Abderrazek Karoui

Penalized selection criteria like AIC or BIC are among the most popular methods for variable selection. Their theoretical properties have been studied intensively and are well understood, but making use of them in case of high-dimensional…

Methodology · Statistics 2016-04-27 Florian Frommlet , Gregory Nuel

Sparse regression and variable selection for large-scale data have been rapidly developed in the past decades. This work focuses on sparse ridge regression, which enforces the sparsity by use of the L0 norm. We first prove that the…

Computation · Statistics 2020-06-30 Weijun Xie , Xinwei Deng

We in this paper propose a directional regression based approach for ultrahigh dimensional sufficient variable screening with censored responses. The new method is designed in a model-free manner and thus can be adapted to various complex…

Methodology · Statistics 2018-02-28 Menghao Xu , Zhou Yu , Jun Shao

This is a tutorial and survey paper on various methods for Sufficient Dimension Reduction (SDR). We cover these methods with both statistical high-dimensional regression perspective and machine learning approach for dimensionality…

Methodology · Statistics 2021-10-20 Benyamin Ghojogh , Ali Ghodsi , Fakhri Karray , Mark Crowley

We analyze the prediction error of ridge regression in an asymptotic regime where the sample size and dimension go to infinity at a proportional rate. In particular, we consider the role played by the structure of the true regression…

Statistics Theory · Mathematics 2021-03-09 Dominic Richards , Jaouad Mourtada , Lorenzo Rosasco

Popularly used eigendecomposition-based criteria such as BIC type, ratio estimation and principal component-based criterion often underdetermine model dimensionality for regressions or the number of factors for factor models. This…

Statistics Theory · Mathematics 2016-08-17 Xuehu Zhu , Tao Wang , Lixing Zhu

Inexpensive surrogates are useful for reducing the cost of science and engineering studies involving large-scale, complex computational models with many input parameters. A ridge approximation is one class of surrogate that models a…

Numerical Analysis · Mathematics 2019-03-01 Jeffrey M. Hokanson , Paul G. Constantine

In high-dimensional statistics, variable selection recovers the latent sparse patterns from all possible covariate combinations. This paper proposes a novel optimization method to solve the exact L0-regularized regression problem, which is…

Methodology · Statistics 2022-06-02 Mingzhang Yin , Nhat Ho , Bowei Yan , Xiaoning Qian , Mingyuan Zhou

We introduce a new criterion, the Rank Selection Criterion (RSC), for selecting the optimal reduced rank estimator of the coefficient matrix in multivariate response regression models. The corresponding RSC estimator minimizes the Frobenius…

Statistics Theory · Mathematics 2011-10-18 Florentina Bunea , Yiyuan She , Marten H. Wegkamp

While recent years have witnessed a rapid growth of research papers on recommender system (RS), most of the papers focus on inventing machine learning models to better fit user behavior data. However, user behavior data is observational…

Information Retrieval · Computer Science 2021-12-30 Jiawei Chen , Hande Dong , Xiang Wang , Fuli Feng , Meng Wang , Xiangnan He

In this paper, I will introduce a new form of regression, that can adjust overfitting and underfitting through, "distance-based regression." Overfitting often results in finding false patterns causing inaccurate results, so by having a new…

Machine Learning · Computer Science 2024-10-25 Dylan Wilson

Reducing hidden bias in the data and ensuring fairness in algorithmic data analysis has recently received significant attention. We complement several recent papers in this line of research by introducing a general method to reduce bias in…

Data Structures and Algorithms · Computer Science 2021-03-09 Aris Anagnostopoulos , Luca Becchetti , Adriano Fazzone , Cristina Menghini , Chris Schwiegelshohn

We propose a quantum algorithm based on ridge regression model, which get the optimal fitting parameters w and a regularization hyperparameter {\alpha} by analysing the training dataset. The algorithm consists of two subalgorithms. One is…

Quantum Physics · Physics 2021-04-28 Menghan Chen , Chaohua Yu , Gongde Guo , Song Lin