English
Related papers

Related papers: Feature Selection based on the Local Lift Dependen…

200 papers

Machine learning methods are used to discover complex nonlinear relationships in biological and medical data. However, sophisticated learning models are computationally unfeasible for data with millions of features. Here we introduce the…

Penalized regression methods, most notably the lasso, are a popular approach to analyzing high-dimensional data. An attractive property of the lasso is that it naturally performs variable selection. An important area of concern, however, is…

Methodology · Statistics 2026-05-13 Ryan Miller , Patrick Breheny

Generalizing to novel classes unseen during training is a key challenge of few-shot classification. Recent metric-based methods try to address this by local representations. However, they are unable to take full advantage of them due to (i)…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Shi Tang , Guiming Luo , Xinchen Ye , Zhiyi Xia

Feature selection by maximizing high-order mutual information between the selected feature vector and a target variable is the gold standard in terms of selecting the best subset of relevant features that maximizes the performance of…

Machine Learning · Computer Science 2022-10-19 Magda Amiridi , Nikos Kargas , Nicholas D. Sidiropoulos

Growth is a multi-layered phenomenon in human societies, composed of socioeconomic and demographic change at many different scales. Yet, standard macroeconomic indicators average over most of these processes, blurring the spatial and…

Physics and Society · Physics 2025-11-11 Jordan T Kemp , Laura Fürsich , Luís M A Bettencourt

In many real-world machine learning problems, feature values are not readily available. To make predictions, some of the missing features have to be acquired, which can incur a cost in money, computational time, or human time, depending on…

Machine Learning · Computer Science 2019-12-20 Kimmo Kärkkäinen , Mohammad Kachuee , Orpaz Goldstein , Majid Sarrafzadeh

Federated learning is a distributed machine learning approach where multiple clients collaboratively train a model without sharing their local data, which contributes to preserving privacy. A challenge in federated learning is managing…

Machine Learning · Computer Science 2025-03-04 Rickard Brännvall

Feature selection has drawn much attention over the last decades in machine learning because it can reduce data dimensionality while maintaining the original physical meaning of features, which enables better interpretability than feature…

Machine Learning · Computer Science 2022-09-27 Yiwen Liao , Jochen Rivoir , Raphaël Latty , Bin Yang

Feature selection and instance selection are two important techniques of data processing. However, such selections have mostly been studied separately, while existing work towards the joint selection conducts feature/instance selection…

Machine Learning · Computer Science 2022-05-18 Wei Fan , Kunpeng Liu , Hao Liu , Hengshu Zhu , Hui Xiong , Yanjie Fu

Recent researches demonstrate that self-localization performance is a very useful measure of likelihood-of-change (LoC) for change detection. In this paper, this "detection-by-localization" scheme is studied in a novel generalized task of…

Robotics · Computer Science 2018-09-17 Tanaka Kanji

Keypoint detection and description is fundamental yet important in many vision applications. Most existing methods use detect-then-describe or detect-and-describe strategy to learn local features without considering their context…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Siyu Hong , Kunhong Li , Yongcong Zhang , Zhiheng Fu , Mengyi Liu , Yulan Guo

Deciding what to sense is a crucial task, made harder by dependencies and by a nonadditive utility function. We develop approximation algorithms for selecting an optimal set of measurements, under a dependency structure modeled by a…

Artificial Intelligence · Computer Science 2012-06-18 Yan Radovilsky , Solomon Eyal Shimony

From a machine learning point of view, identifying a subset of relevant features from a real data set can be useful to improve the results achieved by classification methods and to reduce their time and space complexity. To achieve this…

Machine Learning · Computer Science 2017-05-23 Pietro Cassara , Alessandro Rozza , Mirco Nanni

Existing deep embedding methods in vision tasks are capable of learning a compact Euclidean space from images, where Euclidean distances correspond to a similarity metric. To make learning more effective and efficient, hard sample mining is…

Computer Vision and Pattern Recognition · Computer Science 2016-10-28 Chen Huang , Chen Change Loy , Xiaoou Tang

Feature selection and attribute reduction are crucial problems, and widely used techniques in the field of machine learning, data mining and pattern recognition to overcome the well-known phenomenon of the Curse of Dimensionality, by either…

Machine Learning · Computer Science 2018-11-26 Javad Rahimipour Anaraki , Saeed Samet , Mahdi Eftekhari , Chang Wook Ahn

In this paper, we will outline a novel data-driven method for estimating functions in a multivariate nonparametric regression model based on an adaptive knot selection for B-splines. The underlying idea of our approach for selecting knots…

Methodology · Statistics 2024-01-26 Mary E. Savino , Céline Lévy-Leduc

The growth of data today poses a challenge in management and inference. While feature extraction methods are capable of reducing the size of the data for inference, they do not help in minimizing the cost of data storage. On the other hand,…

Machine Learning · Computer Science 2022-03-04 Thu Nguyen , Thanh Nhan Phan , Van Nhuong Nguyen , Thanh Binh Nguyen , Pål Halvorsen , Michael Riegler

Omic data are characterized by the presence of strong dependence structures that result either from data acquisition or from some underlying biological processes. In metabolomics, for instance, data resulting from Liquid Chromatography-Mass…

Choosing which properties of the data to use as input to multivariate decision algorithms -- a.k.a. feature selection -- is an important step in solving any problem with machine learning. While there is a clear trend towards training…

High Energy Physics - Phenomenology · Physics 2022-12-02 Ranit Das , Gregor Kasieczka , David Shih

Feature Selection techniques aim at finding a relevant subset of features that perform equally or better than the original set of features at explaining the behavior of data. Typically, features are extracted from feature ranking or subset…

Machine Learning · Computer Science 2024-11-05 Jesus S. Aguilar-Ruiz