English
Related papers

Related papers: Hyperdimensional Vector Tsetlin Machines with Appl…

200 papers

Supervised time-series classification garners widespread interest because of its applicability throughout a broad application domain including finance, astronomy, biosensors, and many others. In this work, we tackle this problem with hybrid…

Quantum Physics · Physics 2024-02-20 Jack S. Baker , Gilchan Park , Kwangmin Yu , Ara Ghukasyan , Oktay Goktas , Santosh Kumar Radha

The Tsetlin Machine (TM) is a machine learning algorithm founded on the classical Tsetlin Automaton (TA) and game theory. It further leverages frequent pattern mining and resource allocation principles to extract common patterns in the…

Machine Learning · Computer Science 2020-04-08 Saeed Rahimi Gorji , Ole-Christoffer Granmo , Sondre Glimsdal , Jonathan Edwards , Morten Goodwin

The Tsetlin Machine (TM) is a novel machine learning algorithm with several distinct properties, including transparent inference and learning using hardware-near building blocks. Although numerous papers explore the TM empirically, many of…

Machine Learning · Computer Science 2021-01-08 Lei Jiao , Xuan Zhang , Ole-Christoffer Granmo , K. Darshana Abeyrathna

Using logical clauses to represent patterns, Tsetlin Machines (TMs) have recently obtained competitive performance in terms of accuracy, memory footprint, energy, and learning speed on several benchmarks. Each TM clause votes for or against…

Artificial Intelligence · Computer Science 2021-06-10 K. Darshana Abeyrathna , Bimal Bhattarai , Morten Goodwin , Saeed Gorji , Ole-Christoffer Granmo , Lei Jiao , Rupsa Saha , Rohan K. Yadav

Efficiently capturing the long-range patterns in sequential data sources salient to a given task -- such as classification and generative modeling -- poses a fundamental challenge. Popular approaches in the space tradeoff between the memory…

Machine Learning · Computer Science 2023-11-03 Jiaxin Shi , Ke Alexander Wang , Emily B. Fox

Capsules are the name given by Geoffrey Hinton to vector-valued neurons. Neural networks traditionally produce a scalar value for an activated neuron. Capsules, on the other hand, produce a vector of values, which Hinton argues correspond…

Computer Vision and Pattern Recognition · Computer Science 2021-01-28 Adam Byerly , Tatiana Kalganova

Hyperdimensional computing (HDC), also known as vector symbolic architectures (VSA), is a computing framework used within artificial intelligence and cognitive computing that operates with distributed vector representations of large fixed…

Artificial Intelligence · Computer Science 2022-05-18 Dmitri A. Rachkovskij , Denis Kleyko

Convolutional neural networks (CNNs) have obtained astounding successes for important pattern recognition tasks, but they suffer from high computational complexity and the lack of interpretability. The recent Tsetlin Machine (TM) attempts…

Machine Learning · Computer Science 2019-12-30 Ole-Christoffer Granmo , Sondre Glimsdal , Lei Jiao , Morten Goodwin , Christian W. Omlin , Geir Thore Berge

Sequence labeling models often benefit from incorporating external knowledge. However, this practice introduces data heterogeneity and complicates the model with additional modules, leading to increased expenses for training a…

Computation and Language · Computer Science 2025-06-19 Xuemei Tang , Jun Wang , Qi Su , Chu-ren Huang , Jinghang Gu

Hyperdimensional Computing (HDC) is a computation framework based on properties of high-dimensional random spaces. It is particularly useful for machine learning in resource-constrained environments, such as embedded systems and IoT, as it…

Machine Learning · Computer Science 2022-05-18 Igor Nunes , Mike Heddes , Tony Givargis , Alexandru Nicolau

Hyperdimensional Computing affords simple, yet powerful operations to create long Hyperdimensional Vectors (hypervectors) that can efficiently encode information, be used for learning, and are dynamic enough to be modified on the fly. In…

Symbolic Computation · Computer Science 2022-06-01 Peter Sutor , Dehao Yuan , Douglas Summers-Stay , Cornelia Fermuller , Yiannis Aloimonos

The recently introduced Tsetlin Machine (TM) has provided competitive pattern recognition accuracy in several benchmarks, however, requires a 3-dimensional hyperparameter search. In this paper, we introduce the Multigranular Tsetlin Machine…

Machine Learning · Computer Science 2019-09-17 Saeed Rahimi Gorji , Ole-Christoffer Granmo , Adrian Phoulady , Morten Goodwin

Advances in bioinformatics are primarily due to new algorithms for processing diverse biological data sources. While sophisticated alignment algorithms have been pivotal in analyzing biological sequences, deep learning has substantially…

We propose a new encoder-decoder approach to learn distributed sentence representations that are applicable to multiple purposes. The model is learned by using a convolutional neural network as an encoder to map an input sentence into a…

Computation and Language · Computer Science 2017-07-28 Zhe Gan , Yunchen Pu , Ricardo Henao , Chunyuan Li , Xiaodong He , Lawrence Carin

Hyperdimensional (HD) computing is built upon its unique data type referred to as hypervectors. The dimension of these hypervectors is typically in the range of tens of thousands. Proposed to solve cognitive tasks, HD computing aims at…

Machine Learning · Computer Science 2020-06-08 Lulu Ge , Keshab K. Parhi

Hierarchical text classification (HTC) is essential for various real applications. However, HTC models are challenging to develop because they often require processing a large volume of documents and labels with hierarchical taxonomy.…

Computation and Language · Computer Science 2023-11-08 SangHun Im , Gibaeg Kim , Heung-Seon Oh , Seongung Jo , Donghwan Kim

Hyperdimensional computing (HDC) is a paradigm for data representation and learning originating in computational neuroscience. HDC represents data as high-dimensional, low-precision vectors which can be used for a variety of information…

Genomic sequence analysis plays a crucial role in various scientific and medical domains. Traditional machine-learning approaches often struggle to capture the complex relationships and hierarchical structures of sequence data when working…

Machine Learning · Computer Science 2025-10-02 Sarwan Ali , Haris Mansoor , Murray Patterson

We consider the problem of high-dimensional non-linear variable selection for supervised learning. Our approach is based on performing linear selection among exponentially many appropriately defined positive definite kernels that…

Machine Learning · Computer Science 2009-09-08 Francis Bach

Following the initial publication of hdlib, a Python library for designing Vector-Symbolic Architectures (VSA), we introduce a major extension that significantly enhances its machine learning capabilities. VSA, also known as…

Machine Learning · Computer Science 2026-01-07 Fabio Cumbo , Kabir Dhillon , Daniel Blankenberg