English
Related papers

Related papers: Model selection for high-dimensional linear regres…

200 papers

Regression models fitted to data can be assessed on their goodness of fit, though models with many parameters should be disfavored to prevent over-fitting. Statisticians' tools for this are little known to physical scientists. These include…

Methodology · Statistics 2013-05-28 Robert S. Maier

We analyze greedy algorithms for the Hierarchical Aggregation (HAG) problem, a strategy introduced in [Jia et al., KDD 2020] for speeding up learning on Graph Neural Networks (GNNs). The idea of HAG is to identify and remove redundancies in…

Data Structures and Algorithms · Computer Science 2021-02-09 Alexandra Porter , Mary Wootters

Logistic regression is key method for modeling the probability of a binary outcome based on a collection of covariates. However, the classical formulation of logistic regression relies on the independent sampling assumption, which is often…

Statistics Theory · Mathematics 2024-09-25 Somabha Mukherjee , Ziang Niu , Sagnik Halder , Bhaswar B. Bhattacharya , George Michailidis

We propose the orthogonal random forest, an algorithm that combines Neyman-orthogonality to reduce sensitivity with respect to estimation error of nuisance parameters with generalized random forests (Athey et al., 2017)--a flexible…

Machine Learning · Computer Science 2019-09-27 Miruna Oprescu , Vasilis Syrgkanis , Zhiwei Steven Wu

We establish oracle inequalities for a version of the Lasso in high-dimensional fixed effects dynamic panel data models. The inequalities are valid for the coefficients of the dynamic and exogenous regressors. Separate oracle inequalities…

Statistics Theory · Mathematics 2016-01-05 Anders Bredahl Kock , Haihan Tang

The Bayesian inference approach is widely used to tackle inverse problems due to its versatile and natural ability to handle ill-posedness. However, it often faces challenges when dealing with situations involving continuous fields or…

Numerical Analysis · Mathematics 2023-08-28 Xinchao Jiang , Xin Wang , Ziming Wen , Hu Wang

The projection operation is a critical component in a wide range of optimization algorithms, such as online gradient descent (OGD), for enforcing constraints and achieving optimal regret bounds. However, it suffers from computational…

Machine Learning · Computer Science 2024-06-04 Zihao Hu , Guanghui Wang , Jacob Abernethy

We consider the problem of inferring the conditional independence graph (CIG) of a sparse, high-dimensional stationary multivariate Gaussian time series. A sparse-group lasso-based frequency-domain formulation of the problem based on…

Signal Processing · Electrical Eng. & Systems 2024-06-06 Jitendra K. Tugnait

In this paper, we consider a randomized greedy algorithm for independent sets in $r$-uniform $d$-regular hypergraphs $G$ on $n$ vertices with girth $g$. By analyzing the expected size of the independent sets generated by this algorithm, we…

Combinatorics · Mathematics 2022-01-06 Jiaxi Nie , Jacques Verstraete

The first investigation is made of designs for screening experiments where the response variable is approximated by a generalised linear model. A Bayesian information capacity criterion is defined for the selection of designs that are…

Methodology · Statistics 2016-10-27 David C. Woods , James M. McGree , Susan M. Lewis

Although a majority of the theoretical literature in high-dimensional statistics has focused on settings which involve fully-observed data, settings with missing values and corruptions are common in practice. We consider the problems of…

Machine Learning · Statistics 2017-11-06 Yining Wang , Jialei Wang , Sivaraman Balakrishnan , Aarti Singh

We develop a constructive approach to estimating sparse, high-dimensional linear regression models. The approach is a computational algorithm motivated from the KKT conditions for the $\ell_0$-penalized least squares solutions. It generates…

Computation · Statistics 2017-01-19 Jian Huang , Yuling Jiao , Yanyan Liu , Xiliang Lu

High-dimensional time series data appear in many scientific areas in the current data-rich environment. Analysis of such data poses new challenges to data analysts because of not only the complicated dynamic dependence between the series,…

Methodology · Statistics 2022-06-22 Di Wang , Ruey S. Tsay

Several regularization methods have been considered over the last decade for sparse high-dimensional linear regression models, but the most common ones use the least square (quadratic) or likelihood loss and hence are not robust against…

Statistics Theory · Mathematics 2020-08-03 Elena Castilla , Abhik Ghosh , María Jaenada , Leandro Pardo

We propose a greedy algorithm to select $N$ important features among $P$ input features for a non-linear prediction problem. The features are selected one by one sequentially, in an iterative loss minimization procedure. We use neural…

Machine Learning · Computer Science 2023-09-14 Sandipan Das , Alireza M. Javid , Prakash Borpatra Gohain , Yonina C. Eldar , Saikat Chatterjee

We develop an algorithm for model selection which allows for the consideration of a combinatorially large number of candidate models governing a dynamical system. The innovation circumvents a disadvantage of standard model selection which…

Data Analysis, Statistics and Probability · Physics 2017-11-01 Niall M. Mangan , J. Nathan Kutz , Steven L. Brunton , Joshua L. Proctor

The past decade has witnessed a surge of endeavors in statistical inference for high-dimensional sparse regression, particularly via de-biasing or relaxed orthogonalization. Nevertheless, these techniques typically require a more stringent…

Statistics Theory · Mathematics 2021-11-29 Yang Li , Zemin Zheng , Jia Zhou , Ziwei Zhu

In this article, we present a family of numerical approaches to solve high-dimensional linear non-symmetric problems. The principle of these methods is to approximate a function which depends on a large number of variates by a sum of tensor…

Functional Analysis · Mathematics 2012-10-26 Eric Cances , Virginie Ehrlacher , Tony Lelievre

Robust Ordinal Regression (ROR) is a way of dealing with Multiple Criteria Decision Aiding (MCDA), by considering all sets of parameters of an assumed preference model, that are compatible with preference information given by the Decision…

Optimization and Control · Mathematics 2012-06-28 Salvatore Corrente , Salvatore Greco , Roman Slowinski

We consider the problem of jointly estimating multiple related directed acyclic graph (DAG) models based on high-dimensional data from each graph. This problem is motivated by the task of learning gene regulatory networks based on gene…

Statistics Theory · Mathematics 2020-06-30 Yuhao Wang , Santiago Segarra , Caroline Uhler