English
Related papers

Related papers: Higher Order Mutual Information Approximation for …

200 papers

Feature selection and reducing the dimensionality of data is an essential step in data analysis. In this work, we propose a new criterion for feature selection that is formulated as conditional information between features given the labeled…

Machine Learning · Statistics 2019-05-20 Salimeh Yasaei Sekeh , Alfred O. Hero

Existing unsupervised hash learning is a kind of attribute-centered calculation. It may not accurately preserve the similarity between data. This leads to low down the performance of hash function learning. In this paper, a hash algorithm…

Machine Learning · Computer Science 2022-06-07 Shichao Zhang , Jiaye Li

Feature selection is crucial for pinpointing relevant features in high-dimensional datasets, mitigating the 'curse of dimensionality,' and enhancing machine learning performance. Traditional feature selection methods for classification use…

Machine Learning · Computer Science 2025-04-08 Rittwika Kansabanik , Adrian Barbu

Band selection, by choosing a set of representative bands in hyperspectral image (HSI), is an effective method to reduce the redundant information without compromising the original contents. Recently, various unsupervised band selection…

Image and Video Processing · Electrical Eng. & Systems 2019-05-01 Qi Wang , Fahong Zhang , Xuelong Li

A general formulation of optimization problems in which various candidate solutions may use different feature-sets is presented, encompassing supervised classification, automated program learning and other cases. A novel characterization of…

Machine Learning · Computer Science 2017-03-22 Ben Goertzel , Nil Geisweiller , Chris Poulin

A highly comparative, feature-based approach to time series classification is introduced that uses an extensive database of algorithms to extract thousands of interpretable features from time series. These features are derived from across…

Machine Learning · Computer Science 2017-11-10 Ben D. Fulcher , Nick S. Jones

Multi-view unsupervised feature selection (MUFS), which selects informative features from multi-view unlabeled data, has attracted increasing research interest in recent years. Although great efforts have been devoted to MUFS, several…

Machine Learning · Computer Science 2025-11-12 Minghui Lu , Yanyong Huang , Minbo Ma , Jinyuan Chang , Dongjie Wang , Xiuwen Yi , Tianrui Li

The purpose of this master's thesis is to study and develop a new algorithmic framework for collaborative filtering (CF) to generate recommendations. The method we propose is based on the exploitation of the hierarchical structure of the…

Information Retrieval · Computer Science 2015-12-24 Marianna Kouneli

Detection and description of keypoints from an image is a well-studied problem in Computer Vision. Some methods like SIFT, SURF or ORB are computationally really efficient. This paper proposes a solution for a particular case study on…

Computer Vision and Pattern Recognition · Computer Science 2020-06-05 Ibon Merino , Jon Azpiazu , Anthony Remazeilles , Basilio Sierra

Unsupervised feature selection (UFS) is widely applied in machine learning and pattern recognition. However, most of the existing methods only consider a single sparsity, which makes it difficult to select valuable and discriminative…

Optimization and Control · Mathematics 2025-01-03 Xianchao Xiu , Anning Yang , Chenyi Huang , Xinrong Li , Wanquan Liu

Software fault prediction (SFP) is a critical task in software engineering, enabling early identification of faults in modules to improve software quality and reduce maintenance costs. This research investigates the combined effects of…

Software Engineering · Computer Science 2026-05-19 Ahmad Nauman Ghazi , Nagajyothi Devarapalli , Ashir Javeed , Sadi Alawadi , Fahed Alkhabbas , Khalid AlKharabsheh

There have been several attempts to develop Feature Selection (FS) algorithms capable of identifying features that are relevant in a dataset. Although in certain applications the FS algorithms can be seen to be successful, they have similar…

Machine Learning · Computer Science 2025-03-18 Andrew Starkey , Uduak Idio Akpan , Omaimah AL Hosni , Yaseen Pullissery

In this work a new way to calculate the multivariate joint entropy is presented. This measure is the basis for a fast information-theoretic based evaluation of gene relevance in a Microarray Gene Expression data context. Its low complexity…

Quantitative Methods · Quantitative Biology 2013-02-08 Fernando González , Lluís A. Belanche

We investigate the problem of selecting features for datasets that can be naturally partitioned into subgroups (e.g., according to socio-demographic groups and age), each with its own dominant set of features. Within this subgroup-oriented…

Machine Learning · Computer Science 2024-12-10 Bar Genossar , Thinh On , Md. Mouinul Islam , Ben Eliav , Senjuti Basu Roy , Avigdor Gal

Feature selection has emerged as a crucial technique in refining recommender systems. Recent advancements leveraging Automated Machine Learning (AutoML) has drawn significant attention, particularly in two main categories: early feature…

Information Retrieval · Computer Science 2025-09-16 Fan Hu , Gaofeng Lu , Jun Chen , Chaonan Guo , Yuekui Yang , Xirong Li

Feature selection is important for high-dimensional data analysis and is non-trivial in unsupervised learning problems such as dimensionality reduction and clustering. The goal of unsupervised feature selection is finding a subset of…

Machine Learning · Computer Science 2024-11-26 Ziheng Sun , Chris Ding , Jicong Fan

Effective feature selection is essential for high-dimensional data analysis and machine learning. Unsupervised feature selection (UFS) aims to simultaneously cluster data and identify the most discriminative features. Most existing UFS…

Machine Learning · Statistics 2026-03-23 Feng Yu , MD Saifur Rahman Mazumder , Ying Su , Oscar Contreras Velasco

Feature engineering has become one of the most important steps to improve model prediction performance, and to produce quality datasets. However, this process requires non-trivial domain-knowledge which involves a time-consuming process.…

In this paper, we introduce Partial Information Decomposition of Features (PIDF), a new paradigm for simultaneous data interpretability and feature selection. Contrary to traditional methods that assign a single importance value, our…

Machine Learning · Computer Science 2025-11-17 Charles Westphal , Stephen Hailes , Mirco Musolesi

Feature selection with large-scale high-dimensional data is important yet very challenging in machine learning and data mining. Online feature selection is a promising new paradigm that is more efficient and scalable than batch feature…

Machine Learning · Computer Science 2015-11-20 Yue Wu , Steven C. H. Hoi , Tao Mei , Nenghai Yu