English
Related papers

Related papers: The Weighted Tsetlin Machine: Compressed Represent…

200 papers

The Tsetlin Machine (TM) is a novel alternative to deep neural networks (DNNs). Unlike DNNs, which rely on multi-path arithmetic operations, a TM learns propositional logic patterns from data literals using Tsetlin automata. This…

Machine Learning · Computer Science 2025-02-11 Shengyu Duan , Rishad Shafik , Alex Yakovlev

Using logical clauses to represent patterns, Tsetlin Machines (TMs) have recently obtained competitive performance in terms of accuracy, memory footprint, energy, and learning speed on several benchmarks. Each TM clause votes for or against…

Artificial Intelligence · Computer Science 2021-06-10 K. Darshana Abeyrathna , Bimal Bhattarai , Morten Goodwin , Saeed Gorji , Ole-Christoffer Granmo , Lei Jiao , Rupsa Saha , Rohan K. Yadav

Tsetlin Machines (TMs) capture patterns using conjunctive clauses in propositional logic, thus facilitating interpretation. However, recent TM-based approaches mainly rely on inspecting the full range of clauses individually. Such…

Machine Learning · Computer Science 2020-07-29 Christian D. Blakely , Ole-Christoffer Granmo

Tsetlin Machine (TM) has been gaining popularity as an inherently interpretable machine leaning method that is able to achieve promising performance with low computational complexity on a variety of applications. The interpretability and…

Machine Learning · Computer Science 2022-12-29 Jivitesh Sharma , Ole-Christoffer Granmo , Lei Jiao

The Tsetlin Machine (TM) has recently attracted attention as a low-power alternative to neural networks due to its simple and interpretable inference mechanisms. However, its performance on speech-related tasks remains limited. This paper…

Sound · Computer Science 2025-10-29 Baizhou Lin , Yuetong Fang , Renjing Xu , Rishad Shafik , Jagmohan Chauhan

TMs are a pattern recognition approach that uses finite state machines for learning and propositional logic to represent patterns. In addition to being natively interpretable, they have provided competitive accuracy for various tasks. In…

Computation and Language · Computer Science 2021-02-23 Rupsa Saha , Ole-Christoffer Granmo , Vladimir I. Zadorozhny , Morten Goodwin

The Tsetlin Machine (TM) offers high-speed inference on resource-constrained devices such as CPUs. Its logic-driven operations naturally lend themselves to parallel execution on modern CPU architectures. Motivated by this, we propose an…

Machine Learning · Computer Science 2025-10-20 Yefan Zeng , Shengyu Duan , Rishad Shafik , Alex Yakovlev

Designing an explainable model becomes crucial now for Natural Language Processing(NLP) since most of the state-of-the-art machine learning models provide a limited explanation for the prediction. In the spectrum of an explainable model,…

Computation and Language · Computer Science 2024-11-08 Rohan Kumar Yadav , Bimal Bhattarai , Abhik Jana , Lei Jiao , Seid Muhie Yimam

The PC algorithm is a widely used method in causal inference for learning the structure of Bayesian networks. Despite its popularity, the PC algorithm suffers from significant time complexity, particularly as the size of the dataset…

Machine Learning · Computer Science 2025-11-25 Kunal Dumbre , Lei Jiao , Ole-Christoffer Granmo

Medical applications challenge today's text categorization techniques by demanding both high accuracy and ease-of-interpretation. Although deep learning has provided a leap ahead in accuracy, this leap comes at the sacrifice of…

We present an all-digital programmable machine learning accelerator chip for image classification, underpinning on the Tsetlin machine (TM) principles. The TM is an emerging machine learning algorithm founded on propositional logic,…

Machine Learning · Computer Science 2025-07-16 Svein Anders Tunheim , Yujin Zheng , Lei Jiao , Rishad Shafik , Alex Yakovlev , Ole-Christoffer Granmo

In this paper, we apply a new promising tool for pattern classification, namely, the Tsetlin Machine (TM), to the field of disease forecasting. The TM is interpretable because it is based on manipulating expressions in propositional logic,…

Machine Learning · Computer Science 2019-06-25 K. Darshana Abeyrathna , Ole-Christoffer Granmo , Xuan Zhang , Morten Goodwin

This paper introduces the Sparse Tsetlin Machine (STM), a novel Tsetlin Machine (TM) that processes sparse data efficiently. Traditionally, the TM does not consider data characteristics such as sparsity, commonly seen in NLP applications…

Machine Learning · Computer Science 2024-05-14 Sebastian Østby , Tobias M. Brambo , Sondre Glimsdal

Masked Language Modeling (MLM) is widely used to pretrain language models. The standard random masking strategy in MLM causes the pre-trained language models (PLMs) to be biased toward high-frequency tokens. Representation learning of rare…

Computation and Language · Computer Science 2023-05-25 Linhan Zhang , Qian Chen , Wen Wang , Chong Deng , Xin Cao , Kongzhang Hao , Yuxin Jiang , Wei Wang

The emergence of Artificial Intelligence (AI) driven Keyword Spotting (KWS) technologies has revolutionized human to machine interaction. Yet, the challenge of end-to-end energy efficiency, memory footprint and system complexity of current…

Audio and Speech Processing · Electrical Eng. & Systems 2021-01-28 Jie Lei , Tousif Rahman , Rishad Shafik , Adrian Wheeldon , Alex Yakovlev , Ole-Christoffer Granmo , Fahim Kawsar , Akhil Mathur

Recent research in novelty detection focuses mainly on document-level classification, employing deep neural networks (DNN). However, the black-box nature of DNNs makes it difficult to extract an exact explanation of why a document is…

Computation and Language · Computer Science 2021-05-12 Bimal Bhattarai , Ole-Christoffer Granmo , Lei Jiao

The Tsetlin Machine (TM) is a novel machine-learning algorithm based on propositional logic, which has obtained state-of-the-art performance on several pattern recognition problems. In previous studies, the convergence properties of TM for…

Machine Learning · Computer Science 2022-12-05 Lei Jiao , Xuan Zhang , Ole-Christoffer Granmo

Neural Turing Machines (NTM) contain memory component that simulates "working memory" in the brain to store and retrieve information to ease simple algorithms learning. So far, only linearly organized memory is proposed, and during…

Artificial Intelligence · Computer Science 2015-10-27 Wei Zhang , Yang Yu , Bowen Zhou

Pretrained language models (PLMs) like BERT provide strong semantic representations but are costly and opaque, while symbolic models such as the Tsetlin Machine (TM) offer transparency but lack semantic generalization. We propose a semantic…

Computation and Language · Computer Science 2026-04-15 Jiechao Gao , Rohan Kumar Yadav , Yuangang Li , Yuandong Pan , Jie Wang , Ying Liu , Michael Lepech

Embedding models in natural language processing (NLP) increasingly rely on deep architectures such as BERT, while simpler models such as Word2Vec provide efficient representations but limited interpretability. The Tsetlin Machine (TM)…

Machine Learning · Computer Science 2026-05-11 Ahmed K. Kadhim , Lei Jiao , Rishad Shafik , Ole-Christoffer Granmo , Mayur Kishor Shende