English
Related papers

Related papers: Deep-gKnock: nonlinear group-feature selection wit…

200 papers

The knockoff filter, recently developed by Barber and Candes, is an effective procedure to perform variable selection with a controlled false discovery rate (FDR). We propose a private version of the knockoff filter by incorporating…

Machine Learning · Statistics 2022-02-01 Mehrdad Pournaderi , Yu Xiang

In convolutional neural network (CNN), dropout cannot work well because dropped information is not entirely obscured in convolutional layers where features are correlated spatially. Except randomly discarding regions or channels, many…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Tianshu Xie , Minghui Liu , Jiali Deng , Xuan Cheng , Xiaomin Wang , Ming Liu

Modern neuroimaging techniques, such as diffusion tensor imaging (DTI) and functional magnetic resonance imaging (fMRI), enable us to model the human brain as a brain network or connectome. Capturing brain networks' structural information…

Deep neural networks face many problems in the field of hyperspectral image classification, lack of effective utilization of spatial spectral information, gradient disappearance and overfitting as the model depth increases. In order to…

Computer Vision and Pattern Recognition · Computer Science 2023-07-14 Guandong Li

Deep learning methods have shown great promise in many practical applications, ranging from speech recognition, visual object recognition, to text processing. However, most of the current deep learning methods suffer from scalability…

Machine Learning · Statistics 2015-08-31 Yanping Huang , Sai Zhang

Recently, methods have been developed to accurately predict the testing performance of a Deep Neural Network (DNN) on a particular task, given statistics of its underlying topological structure. However, further leveraging this newly found…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Stuart Synakowski , Fabian Benitez-Quiroz , Aleix M. Martinez

This paper tackles the problem of feature selection in a highly challenging setting: $\mathbb{E}(y | \boldsymbol{x}) = G(\boldsymbol{x}_{\mathcal{S}_0})$, where $\mathcal{S}_0$ is the set of relevant features and $G$ is an unknown,…

Machine Learning · Statistics 2025-12-16 Junye Du , Zhenghao Li , Zhutong Gu , Long Feng

Sparse Neural Networks (SNNs) have emerged as powerful tools for efficient feature selection. Leveraging the dynamic sparse training (DST) algorithms within SNNs has demonstrated promising feature selection capabilities while drastically…

Group recommender systems aim to generate recommendations that align with the collective preferences of a group, introducing challenges that differ significantly from those in individual recommendation scenarios. This paper presents Joint…

Information Retrieval · Computer Science 2025-04-10 Ngoc Luyen Le , Marie-Hélène Abel

We tackle the problem of selecting from among a large number of variables those that are 'important' for an outcome. We consider situations where groups of variables are also of interest in their own right. For example, each variable might…

Methodology · Statistics 2018-08-13 Eugene Katsevich , Chiara Sabatti

Replacing normal convolutions with group convolutions can significantly increase the computational efficiency of modern deep convolutional networks, which has been widely adopted in compact network architecture designs. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Zhuo Su , Linpu Fang , Wenxiong Kang , Dewen Hu , Matti Pietikäinen , Li Liu

Negative sampling plays a crucial role in training successful sequential recommendation models. Instead of merely employing random negative sample selection, numerous strategies have been proposed to mine informative negative samples to…

Information Retrieval · Computer Science 2023-06-21 Lu Fan , Jiashu Pu , Rongsheng Zhang , Xiao-Ming Wu

One of the core problems in large-scale recommendations is to retrieve top relevant candidates accurately and efficiently, preferably in sub-linear time. Previous approaches are mostly based on a two-step procedure: first learn an…

Information Retrieval · Computer Science 2021-05-19 Weihao Gao , Xiangjun Fan , Chong Wang , Jiankai Sun , Kai Jia , Wenzhi Xiao , Ruofan Ding , Xingyan Bin , Hui Yang , Xiaobing Liu

Gradient Boosted Decision Trees (GBDTs) are widely used for building ranking and relevance models in search and recommendation. Considerations such as latency and interpretability dictate the use of as few features as possible to train…

Machine Learning · Statistics 2021-09-07 Cuize Han , Nikhil Rao , Daria Sorokina , Karthik Subbian

Many contemporary large-scale applications involve building interpretable models linking a large set of potential covariates to a response in a nonlinear fashion, such as when the response is binary. Although this modeling problem has been…

Methodology · Statistics 2017-12-13 Emmanuel Candes , Yingying Fan , Lucas Janson , Jinchi Lv

We introduce a novel privatization framework for high-dimensional controlled variable selection. Our framework enables rigorous False Discovery Rate (FDR) control under differential privacy constraints. While the Model-X knockoff procedure…

Machine Learning · Statistics 2025-08-08 Yuxuan Tao , Adel Javanmard

This paper proposes a deep neural network (DNN)-driven framework to address the longstanding generalization challenge in adaptive filtering (AF). In contrast to traditional AF frameworks that emphasize explicit cost function design, the…

Machine Learning · Statistics 2025-08-07 Qizhen Wang , Gang Wang , Ying-Chang Liang

Modern deep neural networks (DNNs) are extremely powerful; however, this comes at the price of increased depth and having more parameters per layer, making their training and inference more computationally challenging. In an attempt to…

Machine Learning · Statistics 2024-03-04 Lingyu Gu , Yongqi Du , Yuan Zhang , Di Xie , Shiliang Pu , Robert C. Qiu , Zhenyu Liao

Kernel methods form a powerful, versatile, and theoretically-grounded unifying framework to solve nonlinear problems in signal processing and machine learning. The standard approach relies on the kernel trick to perform pairwise evaluations…

Machine Learning · Computer Science 2019-12-11 Kan Li , Jose C. Principe

Contactless 3D finger knuckle patterns have emerged as an effective biometric identifier due to its discriminativeness, visibility from a distance, and convenience. Recent research has developed a deep feature collaboration network which…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Kevin H. M. Cheng , Xu Cheng , Guoying Zhao