English
Related papers

Related papers: A pseudo-RIP for multivariate regression

200 papers

We propose a machine learning approach for quickly solving Mixed Integer Programs (MIP) by learning to prioritize a set of decision variables, which we call pseudo-backdoors, for branching that results in faster solution times.…

Machine Learning · Computer Science 2021-06-10 Aaron Ferber , Jialin Song , Bistra Dilkina , Yisong Yue

Conformal Prediction methods have finite-sample distribution-free marginal coverage guarantees. However, they generally do not offer conditional coverage guarantees, which can be important for high-stakes decisions. In this paper, we…

Machine Learning · Statistics 2024-09-27 Ruijiang Gao , Mingzhang Yin , James McInerney , Nathan Kallus

In this work, we consider a multivariate regression model with one-sided errors. We assume for the regression function to lie in a general H\"{o}lder class and estimate it via a nonparametric local polynomial approach that consists of…

Statistics Theory · Mathematics 2021-02-11 Leonie Selk , Charles Tillier , Orlando Marigliano

Estimating the parameters from $k$ independent Bin$(n,p)$ random variables, when both parameters $n$ and $p$ are unknown, is relevant to a variety of applications. It is particularly difficult if $n$ is large and $p$ is small. Over the past…

Statistics Theory · Mathematics 2018-09-10 Laura Fee Schneider , Thomas Staudt , Axel Munk

Extreme value theory provides an asymptotically justified framework for estimation of exceedance probabilities in regions where few or no observations are available. For multivariate tail estimation, the strength of extremal dependence is…

Probability · Mathematics 2017-02-06 Sebastian Engelke , Jevgenijs Ivanovs

Model Predictive Control (MPC) is widely used to achieve performance objectives, while enforcing operational and safety constraints. Despite its high performance, MPC often demands significant computational resources, making it challenging…

Optimization and Control · Mathematics 2025-01-24 Mohsen Amiri , Mehdi Hosseinzadeh

A nonparametric procedure for robust regression estimation and for quantile regression is proposed which is completely data-driven and adapts locally to the regularity of the regression function. This is achieved by considering in each…

Statistics Theory · Mathematics 2009-04-06 Markus Reiss , Yves Rozenholc , Charles-Andre Cuenod

We study a multivariate regression discontinuity design in which treatment is assigned by crossing a boundary in the space of multiple running variables. We document that the existing bandwidth selector is suboptimal for a multivariate…

Econometrics · Economics 2026-01-26 Masayuki Sawada , Takuya Ishihara , Daisuke Kurisu , Yasumasa Matsuda

In this article, we use L$_p$ depth for classification of multivariate data, where the value of $p$ is chosen adaptively using observations from the training sample. While many depth based classifiers are constructed assuming elliptic…

Methodology · Statistics 2016-11-18 Subhajit Dutta , Anil K. Ghosh

The purpose of this paper is twofold. The first is to point out that the Restricted Isometry Property (RIP) does not hold in many applications where compressed sensing is successfully used. This includes fields like Magnetic Resonance…

Information Theory · Computer Science 2015-10-19 Alexander Bastounis , Anders C. Hansen

Existing work has linked properties of a function's gradient to the difficulty of function approximation. Motivated by these insights, we study how gradient information can be leveraged to improve neural network's ability to approximate…

Machine Learning · Computer Science 2026-02-11 Yangchen Pan , Qizhen Ying , Philip Torr , Bo Liu

We derive the ideal train/test split for the ridge regression to high accuracy in the limit that the number of training rows m becomes large. The split must depend on the ridge tuning parameter, alpha, but we find that the dependence is…

Machine Learning · Statistics 2025-09-08 Alexander Dubbs

We present a mean-variance policy iteration (MVPI) framework for risk-averse control in a discounted infinite horizon MDP optimizing the variance of a per-step reward random variable. MVPI enjoys great flexibility in that any policy…

Machine Learning · Computer Science 2022-04-08 Shangtong Zhang , Bo Liu , Shimon Whiteson

From benign overfitting in overparameterized models to rich power-law scalings in performance, simple ridge regression displays surprising behaviors sometimes thought to be limited to deep neural networks. This balance of phenomenological…

Machine Learning · Statistics 2026-05-08 Alexander Atanasov , Jacob A. Zavatone-Veth , Cengiz Pehlevan

This work studies finite-sample properties of the risk of the minimum-norm interpolating predictor in high-dimensional regression models. If the effective rank of the covariance matrix $\Sigma$ of the $p$ regression features is much larger…

Machine Learning · Statistics 2021-03-23 Florentina Bunea , Seth Strimas-Mackey , Marten Wegkamp

Modern technologies are producing datasets with complex intrinsic structures, and they can be naturally represented as matrices instead of vectors. To preserve the latent data structures during processing, modern regression approaches…

Machine Learning · Computer Science 2016-11-16 Hang Zhang , Fengyuan Zhu , Shixin Li

M-quantile random-effects regression represents an interesting approach for modelling multilevel data when the interest of researchers is focused on the conditional quantiles. When data are based on complex survey designs, sampling weights…

Statistics Theory · Mathematics 2018-02-23 Francesco Schirripa Spagnolo , Nicola Salvati , Antonella D'Agostino , Ides Nicaise

The Receiver Operating Characteristic (ROC) curve is a useful tool that measures the discriminating power of a continuous variable or the accuracy of a pharmaceutical or medical test to distinguish between two conditions or classes. In…

Methodology · Statistics 2022-07-26 Ana M. Bianco , Graciela Boente , Wenceslao Gonzalez-Manteiga

Representative risk estimation is fundamental to clinical decision-making. However, risks are often estimated from non-representative epidemiologic studies, which usually underrepresent minorities. "Model-based" methods use population…

Methodology · Statistics 2023-04-12 Lingxiao Wang , Yan Li , Barry I. Graubard , Hormuzd A. Katki

Semi-supervised learning techniques are gaining popularity due to their capability of building models that are effective, even when scarce amounts of labeled data are available. In this paper, we present a framework and specific tasks for…

Image and Video Processing · Electrical Eng. & Systems 2022-10-05 Antonio Montanaro , Diego Valsesia , Giulia Fracastoro , Enrico Magli