English
Related papers

Related papers: A Power Analysis for Model-X Knockoffs with $\ell_…

200 papers

Model-free knockoffs is a recently proposed technique for identifying covariates that is likely to have an effect on a response variable. The method is an efficient method to control the false discovery rate in hypothesis tests for separate…

Methodology · Statistics 2019-03-29 Lars Holden , Kristoffer Hellton

A core strength of knockoff methods is their virtually limitless customizability, allowing an analyst to exploit machine learning algorithms and domain knowledge without threatening the method's robust finite-sample false discovery rate…

Statistics Theory · Mathematics 2021-07-15 Xiao Li , William Fithian

A fundamental problem in the high-dimensional regression is to understand the tradeoff between type I and type II errors or, equivalently, false discovery rate (FDR) and power in variable selection. To address this important problem, we…

Statistics Theory · Mathematics 2020-10-30 Hua Wang , Yachong Yang , Zhiqi Bu , Weijie J. Su

In many fields of science, we observe a response variable together with a large number of potential explanatory variables, and would like to be able to discover which variables are truly associated with the response. At the same time, we…

Methodology · Statistics 2015-10-15 Rina Foygel Barber , Emmanuel J. Candès

Power and reproducibility are key to enabling refined scientific discoveries in contemporary big data applications with general high-dimensional nonlinear models. In this paper, we provide theoretical foundations on the power and robustness…

Statistics Theory · Mathematics 2017-09-04 Yingying Fan , Emre Demirkaya , Gaorong Li , Jinchi Lv

Approximate Message Passing (AMP) algorithms are a class of iterative procedures for computationally-efficient estimation in high-dimensional inference and estimation tasks. Due to the presence of an 'Onsager' correction term in its…

Statistics Theory · Mathematics 2023-02-02 Collin Cademartori , Cynthia Rush

This paper develops a framework for testing for associations in a possibly high-dimensional linear model where the number of features/variables may far exceed the number of observational units. In this framework, the observations are split…

Methodology · Statistics 2018-05-04 Rina Foygel Barber , Emmanuel J. Candes

Interpretability and stability are two important features that are desired in many contemporary big data applications arising in economics and finance. While the former is enjoyed to some extent by many existing forecasting approaches, the…

Statistics Theory · Mathematics 2018-09-14 Yingying Fan , Jinchi Lv , Mahrad Sharifvaghefi , Yoshimasa Uematsu

As new Model-X knockoff construction techniques are developed, primarily concerned with determining the correct conditional distribution from which to sample, we focus less on deriving the correct multivariate distribution and instead ask…

Methodology · Statistics 2025-02-05 Christopher Hemmens , Stephan Robert-Nicoud

We address challenges in variable selection with highly correlated data that are frequently present in finance, economics, but also in complex natural systems as e.g. weather. We develop a robustified version of the knockoff framework,…

Econometrics · Economics 2022-06-14 Konstantin Görgen , Abdolreza Nazemi , Melanie Schienle

In many research fields, researchers aim to identify significant associations between a set of explanatory variables and a response while controlling the FDR. The Knockoff filter has been recently proposed in the frequentist paradigm to…

Methodology · Statistics 2026-04-22 Lorenzo Focardi-Olmi , Anna Gottard , Michele Guindani , Marina Vannucci

Many penalized maximum likelihood estimators correspond to posterior mode estimators under specific prior distributions. Appropriateness of a particular class of penalty functions can therefore be interpreted as the appropriateness of a…

Methodology · Statistics 2018-09-11 Maryclare Griffin , Peter D. Hoff

Approximate message passing (AMP) refers to a class of efficient algorithms for statistical estimation in high-dimensional problems such as compressed sensing and low-rank matrix estimation. This paper analyzes the performance of AMP in the…

Information Theory · Computer Science 2018-10-23 Cynthia Rush , Ramji Venkataramanan

Predictive modeling often uses black box machine learning methods, such as deep neural networks, to achieve state-of-the-art performance. In scientific domains, the scientist often wishes to discover which features are actually important…

Machine Learning · Statistics 2020-08-03 Mukund Sudarshan , Wesley Tansey , Rajesh Ranganath

Modern scientific studies often require the identification of a subset of relevant explanatory variables, in the attempt to understand an interesting phenomenon. Several statistical methods have been developed to automate this task, but…

Methodology · Statistics 2019-05-14 Matteo Sesia , Chiara Sabatti , Emmanuel J. Candès

Variable selection is a problem of statistics that aims to find the subset of the $N$-dimensional possible explanatory variables that are truly related to the generation process of the response variable. In high-dimensional setups, where…

Statistics Theory · Mathematics 2025-02-27 Takashi Takahashi

This paper is concerned with the selection and estimation of fixed and random effects in linear mixed effects models. We propose a class of nonconcave penalized profile likelihood methods for selecting and estimating important fixed…

Statistics Theory · Mathematics 2012-11-05 Yingying Fan , Runze Li

We consider the problem of localizing change points in a generalized linear model (GLM), a model that covers many widely studied problems in statistical learning including linear, logistic, and rectified linear regression. We propose a…

Machine Learning · Statistics 2025-09-08 Gabriel Arpino , Xiaoqi Liu , Julia Gontarek , Ramji Venkataramanan

Selecting important features that have substantial effects on the response with provable type-I error rate control is a fundamental concern in statistics, with wide-ranging practical applications. Existing knockoff filters, although shown…

Methodology · Statistics 2024-02-29 Jiaqi Gu , Zihuai He

Approximate Message Passing (AMP) algorithmshave recently gathered significant attention across disciplines such as statistical physics, machine learning, and communication systems. This study aims to extend AMP algorithms to non-symmetric…

Probability · Mathematics 2024-02-14 Mohammed-Younes Gueddari , Walid Hachem , Jamal Najim