English
Related papers

Related papers: A Comparative Study of Feature Selection in Tsetli…

200 papers

Tsetlin Machines (TMs) provide a fundamental shift from arithmetic-based to logic-based machine learning. Supporting convolution, they deal successfully with image classification datasets like MNIST, Fashion-MNIST, and CIFAR-2. However, the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Ole-Christoffer Granmo

Embedded Feature Selection (FS) is a classical approach for interpretable machine learning, aiming to identify the most relevant features of a dataset while simultaneously training the model. We consider an approach based on a hard…

Optimization and Control · Mathematics 2025-08-01 Federico D'Onofrio , Yuri Faenza , Laura Palagi

Feature selection is generally used as one of the most important preprocessing techniques in machine learning, as it helps to reduce the dimensionality of data and assists researchers and practitioners in understanding data. Thereby, by…

Machine Learning · Computer Science 2021-04-26 Yiwen Liao , Raphaël Latty , Bin Yang

Feature selection (FS) remains essential for building accurate and interpretable detection models, particularly in high-dimensional malware datasets. Conventional FS methods such as Extra Trees, Variance Threshold, Tree-based models,…

Machine Learning · Computer Science 2026-02-11 Naveen Gill , Ajvad Haneef K , Madhu Kumar S D

The PC algorithm is a widely used method in causal inference for learning the structure of Bayesian networks. Despite its popularity, the PC algorithm suffers from significant time complexity, particularly as the size of the dataset…

Machine Learning · Computer Science 2025-11-25 Kunal Dumbre , Lei Jiao , Ole-Christoffer Granmo

We present an all-digital programmable machine learning accelerator chip for image classification, underpinning on the Tsetlin machine (TM) principles. The TM is an emerging machine learning algorithm founded on propositional logic,…

Machine Learning · Computer Science 2025-07-16 Svein Anders Tunheim , Yujin Zheng , Lei Jiao , Rishad Shafik , Alex Yakovlev , Ole-Christoffer Granmo

Recent research on model interpretability in natural language processing extensively uses feature scoring methods for identifying which parts of the input are the most important for a model to make a prediction (i.e. explanation or…

Computation and Language · Computer Science 2021-12-07 George Chrysostomou , Nikolaos Aletras

The Tsetlin Machine (TM) has achieved competitive results on several image classification benchmarks, including MNIST, K-MNIST, F-MNIST, and CIFAR-2. However, color image classification is arguably still in its infancy for TMs, with…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Ylva Grønningsæter , Halvor S. Smørvik , Ole-Christoffer Granmo

Machine Learning (ML) techniques are becoming an invaluable support for network intrusion detection, especially in revealing anomalous flows, which often hide cyber-threats. Typically, ML algorithms are exploited to classify/recognize data…

Cryptography and Security · Computer Science 2021-04-13 Mario Di Mauro , Giovanni Galatro , Giancarlo Fortino , Antonio Liotta

In this paper, we apply a new promising tool for pattern classification, namely, the Tsetlin Machine (TM), to the field of disease forecasting. The TM is interpretable because it is based on manipulating expressions in propositional logic,…

Machine Learning · Computer Science 2019-06-25 K. Darshana Abeyrathna , Ole-Christoffer Granmo , Xuan Zhang , Morten Goodwin

We tackle the challenge of feature embedding for the purposes of improving the click-through rate prediction process. We select three models: logistic regression, factorization machines and deep factorization machines, as our baselines and…

Machine Learning · Computer Science 2022-09-21 Samo Pahor , Davorin Kopič , Jure Demšar

In recent years, researchers pay growing attention to the few-shot learning (FSL) task to address the data-scarce problem. A standard FSL framework is composed of two components: i) Pre-train. Employ the base data to generate a CNN-based…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Shuai Shao , Lei Xing , Rui Xu , Weifeng Liu , Yan-Jiang Wang , Bao-Di Liu

Few-shot semantic segmentation (FSS) is a crucial challenge in computer vision, driving extensive research into a diverse range of methods, from advanced meta-learning techniques to simple transfer learning baselines. With the emergence of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Reda Bensaid , Vincent Gripon , François Leduc-Primeau , Lukas Mauch , Ghouthi Boukli Hacene , Fabien Cardinaux

Survey data can contain a high number of features while having a comparatively low quantity of examples. Machine learning models that attempt to predict outcomes from survey data under these conditions can overfit and result in poor…

Computation and Language · Computer Science 2023-08-22 Benjamin C. Warner , Ziqi Xu , Simon Haroutounian , Thomas Kannampallil , Chenyang Lu

Feature selection (FS) is a fundamental challenge in machine learning, particularly for high-dimensional tabular data, where interpretability and computational efficiency are critical. Existing FS methods often cannot automatically detect…

Machine Learning · Computer Science 2026-04-22 Witold Wydmański , Marek Śmieja

Feature selection (FS) is a process which attempts to select more informative features. In some cases, too many redundant or irrelevant features may overpower main features for classification. Feature selection can remedy this problem and…

Machine Learning · Computer Science 2013-06-07 A. Nisthana Parveen , H. Hannah Inbarani , E. N. Sathishkumar

Feature selection is a crucial preprocessing step in data analytics and machine learning. Classical feature selection algorithms select features based on the correlations between predictive features and the class variable and do not attempt…

Machine Learning · Computer Science 2019-11-19 Kui Yu , Xianjie Guo , Lin Liu , Jiuyong Li , Hao Wang , Zhaolong Ling , Xindong Wu

Feature embedding learning and feature interaction modeling are two crucial components of deep models for Click-Through Rate (CTR) prediction. Most existing deep CTR models suffer from the following three problems. First, feature…

Information Retrieval · Computer Science 2021-12-14 Chenxu Zhu , Bo Chen , Weinan Zhang , Jincai Lai , Ruiming Tang , Xiuqiang He , Zhenguo Li , Yong Yu

Accurate and early prediction of a disease allows to plan and improve a patient's quality of future life. During pandemic situations, the medical decision becomes a speed challenge in which physicians have to act fast to diagnose and…

Machine Learning · Computer Science 2022-06-09 Pierluigi Costanzo , Kalia Orphanou

High-dimensional data in many machine learning applications leads to computational and analytical complexities. Feature selection provides an effective way for solving these problems by removing irrelevant and redundant features, thus…

Machine Learning · Computer Science 2019-03-19 Ali Mirzaei , Vahid Pourahmadi , Mehran Soltani , Hamid Sheikhzadeh