English
Related papers

Related papers: Safe Feature Pruning for Sparse High-Order Interac…

200 papers

Swarm intelligence algorithms have traditionally been designed for continuous optimization problems, and these algorithms have been modified and extended for application to discrete optimization problems. Notably, their application in…

Neural and Evolutionary Computing · Computer Science 2024-03-29 Hayata Saitou , Harumi Haraguchi

The applications of traditional statistical feature selection methods to high-dimension, low sample-size data often struggle and encounter challenging problems, such as overfitting, curse of dimensionality, computational infeasibility, and…

Machine Learning · Statistics 2023-12-19 Kexuan Li , Fangfang Wang , Lingli Yang , Ruiqi Liu

Sparse regression is frequently employed in diverse scientific settings as a feature selection method. A pervasive aspect of scientific data that hampers both feature selection and estimation is the presence of strong correlations between…

Methodology · Statistics 2021-03-25 Ankit Kumar , Sharmodeep Bhattacharyya , Kristofer Bouchard

Major complications arise from the recent increase in the amount of high-dimensional data, including high computational costs and memory requirements. Feature selection, which identifies the most relevant and informative attributes of a…

Federated Learning (FL) is a distributed machine learning setting that requires multiple clients to collaborate on training a model while maintaining data privacy. The unaddressed inherent sparsity in data and models often results in overly…

Machine Learning · Statistics 2025-12-30 Krishna Harsha Kovelakuntla Huthasana , Alireza Olama , Andreas Lundell

This paper develops an approach to inference in a linear regression model when the number of potential explanatory variables is larger than the sample size. The approach treats each regression coefficient in turn as the interest parameter,…

Methodology · Statistics 2022-11-14 Heather S. Battey , Nancy Reid

The scarcity of labeled action data poses a considerable challenge for developing machine learning algorithms for robotic object manipulation. It is expensive and often infeasible for a robot to interact with many objects. Conversely,…

Robotics · Computer Science 2024-12-03 Emily Liu , Michael Noseworthy , Nicholas Roy

Multiresponse data with complex group structures in both responses and predictors arises in many fields, yet, due to the difficulty in identifying complex group structures, only a few methods have been studied on this problem. We propose a…

Methodology · Statistics 2022-08-16 Weixiong Liang , Yuehan Yang

Choosing which properties of the data to use as input to multivariate decision algorithms -- a.k.a. feature selection -- is an important step in solving any problem with machine learning. While there is a clear trend towards training…

High Energy Physics - Phenomenology · Physics 2022-12-02 Ranit Das , Gregor Kasieczka , David Shih

Ultra-high dimensional longitudinal data are increasingly common and the analysis is challenging both theoretically and methodologically. We offer a new automatic procedure for finding a sparse semivarying coefficient model, which is widely…

Methodology · Statistics 2014-09-24 Ming-Yen Cheng , Toshio Honda , Jialiang Li , Heng Peng

Many signal processing applications such as acoustic echo cancellation and wireless channel estimation require identifying systems where only a small fraction of coefficients are actually active, i.e. sparse systems. Zero-attracting…

Signal Processing · Electrical Eng. & Systems 2026-03-17 Mohammad Salman , Hadi Zayyani , Felipe A. P. de Figueiredo , Hasan Abu Hilal , Mostafa Rashdan

This paper addresses a new learning algorithm for the recently introduced co-sparse analysis model. First, we give new insights into the co-sparse analysis model by establishing connections to filter-based MRF models, such as the Field of…

Computer Vision and Pattern Recognition · Computer Science 2014-01-14 Yunjin Chen , René Ranftl , Thomas Pock

In industry, feature selection is a standard but necessary step to search for an optimal set of informative feature fields for efficient and effective training of deep Click-Through Rate (CTR) models. Most previous works measure the…

Information Retrieval · Computer Science 2022-09-07 Yi Guo , Zhaocheng Liu , Jianchao Tan , Chao Liao , Sen Yang , Lei Yuan , Dongying Kong , Zhi Chen , Ji Liu

Federated Learning (FL), a privacy-oriented distributed ML paradigm, is being gaining great interest in Internet of Things because of its capability to protect participants data privacy. Studies have been conducted to address challenges…

Cryptography and Security · Computer Science 2023-06-08 Jianhua Wang , Xiaolin Chang , Jelena Mišić , Vojislav B. Mišić , Lin Li , Yingying Yao

Federated Learning (FL) enables clients to collaboratively train machine learning models without sharing local data, preserving privacy in diverse environments. While traditional FL approaches preserve privacy, they often struggle with high…

Machine Learning · Computer Science 2025-02-03 Nan Li , Xiaolu Wang , Xiao Du , Puyu Cai , Ting Wang

Many predictive tasks of web applications need to model categorical variables, such as user IDs and demographics like genders and occupations. To apply standard machine learning techniques, these categorical predictors are always converted…

Machine Learning · Computer Science 2017-08-18 Xiangnan He , Tat-Seng Chua

Safe exploration is a key to applying reinforcement learning (RL) in safety-critical systems. Existing safe exploration methods guaranteed safety under the assumption of regularity, and it has been difficult to apply them to large-scale…

Machine Learning · Computer Science 2021-11-10 Akifumi Wachi , Yunyue Wei , Yanan Sui

Reusing features in deep networks through dense connectivity is an effective way to achieve high computational efficiency. The recent proposed CondenseNet has shown that this mechanism can be further improved if redundant features are…

Computer Vision and Pattern Recognition · Computer Science 2021-04-12 Le Yang , Haojun Jiang , Ruojin Cai , Yulin Wang , Shiji Song , Gao Huang , Qi Tian

Factorization Machines (FMs) are a supervised learning approach that enhances the linear regression model by incorporating the second-order feature interactions. Despite effectiveness, FM can be hindered by its modelling of all feature…

Machine Learning · Computer Science 2017-08-17 Jun Xiao , Hao Ye , Xiangnan He , Hanwang Zhang , Fei Wu , Tat-Seng Chua

In a high-dimensional setting, sparse model has shown its power in computational and statistical efficiency. We consider variables selection problem with a broad class of simultaneous sparsity regularization, enforcing both feature-wise and…

Optimization and Control · Mathematics 2021-09-27 Xinyu Zhang