English
Related papers

Related papers: Normalizing Flows for Knockoff-free Controlled Fea…

200 papers

Feature selection is important step in machine learning since it has shown to improve prediction accuracy while depressing the curse of dimensionality of high dimensional data. The neural networks have experienced tremendous success in…

Machine Learning · Computer Science 2021-07-13 Peter Bugata , Peter Drotar

Researchers in biomedical studies often work with samples that are not selected uniformly at random from the population of interest, a major example being a case-control study. While these designs are motivated by specific scientific…

Continuous improvement in medical imaging techniques allows the acquisition of higher-resolution images. When these are used in a predictive setting, a greater number of explanatory variables are potentially related to the dependent…

Statistics Theory · Mathematics 2019-03-13 Tuan-Binh Nguyen , Jérôme-Alexis Chevalier , Bertrand Thirion

Feature selection is a crucial step in developing robust and powerful machine learning models. Feature selection techniques can be divided into two categories: filter and wrapper methods. While wrapper methods commonly result in strong…

Machine Learning · Computer Science 2022-07-07 Jarne Verhaeghe , Jeroen Van Der Donckt , Femke Ongenae , Sofie Van Hoecke

We propose the group knockoff filter, a method for false discovery rate control in a linear regression setting where the features are grouped, and we would like to select a set of relevant groups which have a nonzero effect on the response.…

Methodology · Statistics 2016-02-12 Ran Dai , Rina Foygel Barber

Model-free knockoffs is a recently proposed technique for identifying covariates that is likely to have an effect on a response variable. The method is an efficient method to control the false discovery rate in hypothesis tests for separate…

Methodology · Statistics 2019-03-29 Lars Holden , Kristoffer Hellton

We propose a new method to learn the structure of a Gaussian graphical model with finite sample false discovery rate control. Our method builds on the knockoff framework of Barber and Cand\`{e}s for linear models. We extend their approach…

Methodology · Statistics 2021-04-20 Jinzhou Li , Marloes H. Maathuis

Convolutional neural networks (CNNs) have achieved remarkable success in image recognition. Although the internal patterns of the input images are effectively learned by the CNNs, these patterns only constitute a small proportion of useful…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Zhengsu Chen , Jianwei Niu , Xuefeng Liu , Shaojie Tang

The knockoff filter is a recent false discovery rate (FDR) control method for high-dimensional linear models. We point out that knockoff has three key components: ranking algorithm, augmented design, and symmetric statistic, and each…

Statistics Theory · Mathematics 2024-02-14 Zheng Tracy Ke , Jun S. Liu , Yucong Ma

The traditional framework for feature selection treats all features as costing the same amount. However, in reality, a scientist often has considerable discretion regarding which variables to measure, and the decision involves a tradeoff…

Methodology · Statistics 2023-02-14 Guo Yu , Daniela Witten , Jacob Bien

Selecting important features that have substantial effects on the response with provable type-I error rate control is a fundamental concern in statistics, with wide-ranging practical applications. Existing knockoff filters, although shown…

Methodology · Statistics 2024-02-29 Jiaqi Gu , Zihuai He

In many scientific fields, researchers are interested in discovering features with substantial effect on the response from a large number of features while controlling the proportion of false discoveries. By incorporating the knockoff…

Methodology · Statistics 2023-02-28 Jiaqi Gu , Guosheng Yin

The knockoff filter, recently developed by Barber and Candes, is an effective procedure to perform variable selection with a controlled false discovery rate (FDR). We propose a private version of the knockoff filter by incorporating…

Machine Learning · Statistics 2022-02-01 Mehrdad Pournaderi , Yu Xiang

We tackle the problem of selecting from among a large number of variables those that are 'important' for an outcome. We consider situations where groups of variables are also of interest in their own right. For example, each variable might…

Methodology · Statistics 2018-08-13 Eugene Katsevich , Chiara Sabatti

Feature selection from a large number of covariates (aka features) in a regression analysis remains a challenge in data science, especially in terms of its potential of scaling to ever-enlarging data and finding a group of scientifically…

Machine Learning · Statistics 2020-02-10 Yiying Fan , Jiayang Sun

Generative flow networks (GFlowNets) are a family of algorithms that learn a generative policy to sample discrete objects $x$ with non-negative reward $R(x)$. Learning objectives guarantee the GFlowNet samples $x$ from the target…

Machine Learning · Computer Science 2023-05-15 Max W. Shen , Emmanuel Bengio , Ehsan Hajiramezanali , Andreas Loukas , Kyunghyun Cho , Tommaso Biancalani

Building compact convolutional neural networks (CNNs) with reliable performance is a critical but challenging task, especially when deploying them in real-world applications. As a common approach to reduce the size of CNNs, pruning methods…

Machine Learning · Computer Science 2020-05-26 Hang Li , Chen Ma , Wei Xu , Xue Liu

Controlling the false discovery rate (FDR) is a popular approach to multiple testing, variable selection, and related problems of simultaneous inference. In many contemporary applications, models are not specified by discrete variables,…

Statistics Theory · Mathematics 2024-04-16 Mateo Díaz , Venkat Chandrasekaran

Anomaly segmentation is an essential capability for safety-critical robotics applications that must be aware of unexpected events. Normalizing flows (NFs), a class of generative models, are a promising approach for this task due to their…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Chang Won Lee , Selina Leveugle , Svetlana Stolpner , Chris Langley , Paul Grouchy , Jonathan Kelly , Steven L. Waslander

The knockoff filter is a powerful tool for controlled variable selection with false discovery rate (FDR) control. In this paper, we leverage e-values to allow the nominal FDR level to be switched post-hoc, after looking at the data and…

Methodology · Statistics 2026-02-20 Lasse Fischer , Konstantinos Sechidis