English
Related papers

Related papers: Drop Clause: Enhancing Performance, Interpretabili…

200 papers

The Tsetlin Machine (TM) is a novel machine learning algorithm with several distinct properties, including transparent inference and learning using hardware-near building blocks. Although numerous papers explore the TM empirically, many of…

Machine Learning · Computer Science 2021-01-08 Lei Jiao , Xuan Zhang , Ole-Christoffer Granmo , K. Darshana Abeyrathna

Despite significant effort, building models that are both interpretable and accurate is an unresolved challenge for many pattern recognition problems. In general, rule-based and linear models lack accuracy, while deep learning…

Artificial Intelligence · Computer Science 2020-05-12 K. Darshana Abeyrathna , Ole-Christoffer Granmo , Morten Goodwin

Tsetlin Machines (TMs) capture patterns using conjunctive clauses in propositional logic, thus facilitating interpretation. However, recent TM-based approaches mainly rely on inspecting the full range of clauses individually. Such…

Machine Learning · Computer Science 2020-07-29 Christian D. Blakely , Ole-Christoffer Granmo

Medical applications challenge today's text categorization techniques by demanding both high accuracy and ease-of-interpretation. Although deep learning has provided a leap ahead in accuracy, this leap comes at the sacrifice of…

Tsetlin Machines (TMs) have emerged as a compelling alternative to conventional deep learning methods, offering notable advantages such as smaller memory footprint, faster inference, fault-tolerant properties, and interpretability. Although…

Machine Learning · Computer Science 2024-11-14 K. Darshana Abeyrathna , Sara El Mekkaoui , Andreas Hafver , Christian Agrell

The recently introduced Tsetlin Machine (TM) has provided competitive pattern recognition accuracy in several benchmarks, however, requires a 3-dimensional hyperparameter search. In this paper, we introduce the Multigranular Tsetlin Machine…

Machine Learning · Computer Science 2019-09-17 Saeed Rahimi Gorji , Ole-Christoffer Granmo , Adrian Phoulady , Morten Goodwin

Recent research in novelty detection focuses mainly on document-level classification, employing deep neural networks (DNN). However, the black-box nature of DNNs makes it difficult to extract an exact explanation of why a document is…

Computation and Language · Computer Science 2021-05-12 Bimal Bhattarai , Ole-Christoffer Granmo , Lei Jiao

The proliferation of fake news, i.e., news intentionally spread for misinformation, poses a threat to individuals and society. Despite various fact-checking websites such as PolitiFact, robust detection techniques are required to deal with…

Computation and Language · Computer Science 2021-05-20 Bimal Bhattarai , Ole-Christoffer Granmo , Lei Jiao

The Tsetlin Machine (TM) is a novel machine learning paradigm that employs finite-state automata for learning and utilizes propositional logic to represent patterns. Due to its simplistic approach, TMs are inherently more interpretable than…

Machine Learning · Computer Science 2025-10-03 Mayur Kishor Shende , Ole-Christoffer Granmo , Runar Helin , Vladimir I. Zadorozhny , Rishad Shafik

TMs are a pattern recognition approach that uses finite state machines for learning and propositional logic to represent patterns. In addition to being natively interpretable, they have provided competitive accuracy for various tasks. In…

Computation and Language · Computer Science 2021-02-23 Rupsa Saha , Ole-Christoffer Granmo , Vladimir I. Zadorozhny , Morten Goodwin

The Tsetlin Machine (TM) offers high-speed inference on resource-constrained devices such as CPUs. Its logic-driven operations naturally lend themselves to parallel execution on modern CPU architectures. Motivated by this, we propose an…

Machine Learning · Computer Science 2025-10-20 Yefan Zeng , Shengyu Duan , Rishad Shafik , Alex Yakovlev

Tsetlin Machine (TM) has been gaining popularity as an inherently interpretable machine leaning method that is able to achieve promising performance with low computational complexity on a variety of applications. The interpretability and…

Machine Learning · Computer Science 2022-12-29 Jivitesh Sharma , Ole-Christoffer Granmo , Lei Jiao

Dropout is a widely used regularization technique which improves the generalization ability of a model by randomly dropping neurons. In light of this, we propose Dropout Prompt Learning, which aims for applying dropout to improve the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Biao Chen , Lin Zuo , Mengmeng Jing , Kunbin He , Yuchen Wang

Interpretable machine learning is essential in high-stakes domains where decision-making requires accountability, transparency, and trust. While rule-based models offer global and exact interpretability, learning rule sets that…

Machine Learning · Computer Science 2026-03-10 Hans Farrell Soegeng , Sarthak Ketanbhai Modi , Thomas Peyrin

Dropout has been demonstrated as a simple and effective module to not only regularize the training process of deep neural networks, but also provide the uncertainty estimation for prediction. However, the quality of uncertainty estimation…

Machine Learning · Computer Science 2021-03-09 Xinjie Fan , Shujian Zhang , Korawat Tanwisuth , Xiaoning Qian , Mingyuan Zhou

Transformer-based language models are widely deployed for reasoning, yet their behavior under inference-time stochasticity remains underexplored. While dropout is common during training, its inference-time effects via Monte Carlo sampling…

Machine Learning · Computer Science 2026-03-19 Antônio Junior Alves Caiado , Michael Hahsler

Embedding models in natural language processing (NLP) increasingly rely on deep architectures such as BERT, while simpler models such as Word2Vec provide efficient representations but limited interpretability. The Tsetlin Machine (TM)…

Machine Learning · Computer Science 2026-05-11 Ahmed K. Kadhim , Lei Jiao , Rishad Shafik , Ole-Christoffer Granmo , Mayur Kishor Shende

The increasing complexity of large-scale language models has amplified concerns regarding their interpretability and reusability. While traditional embedding models like Word2Vec and GloVe offer scalability, they lack transparency and often…

Machine Learning · Computer Science 2025-05-23 Ahmed K. Kadhim , Lei Jiao , Rishad Shafik , Ole-Christoffer Granmo

Data modeling using Tsetlin machines (TMs) is all about building logical rules from the data features. The decisions of the model are based on a combination of these logical rules. Hence, the model is fully transparent and it is possible to…

Dropout is a widely used regularization technique in deep learning, but its effects are typically realized through stochastic masking rather than explicit optimization objectives. We propose a deterministic formulation that expresses…

Machine Learning · Computer Science 2026-04-23 Vidhi Agrawal , Illia Oleksiienko , Alexandros Iosifidis