English
Related papers

Related papers: Efficient Vector Symbolic Architectures from Histo…

200 papers

Vector Symbolic Architectures combine a high-dimensional vector space with a set of carefully designed operators in order to perform symbolic computations with large numerical vectors. Major goals are the exploitation of their…

Artificial Intelligence · Computer Science 2021-12-17 Kenny Schlegel , Peer Neubert , Peter Protzel

The Abstraction and Reasoning Corpus for Artificial General Intelligence (ARC-AGI) is a generative, few-shot fluid intelligence benchmark. Although humans effortlessly solve ARC-AGI, it remains extremely difficult for even the most advanced…

Artificial Intelligence · Computer Science 2025-11-13 Isaac Joffe , Chris Eliasmith

Motivated by recent innovations in biologically-inspired neuromorphic hardware, this article presents a novel unsupervised machine learning algorithm named Hyperseed that draws on the principles of Vector Symbolic Architectures (VSA) for…

Artificial Intelligence · Computer Science 2022-09-30 Evgeny Osipov , Sachin Kahawala , Dilantha Haputhanthri , Thimal Kempitiya , Daswin De Silva , Damminda Alahakoon , Denis Kleyko

Connectionist approaches to machine learning, \emph{i.e.} neural networks, are enjoying a considerable vogue right now. However, these methods require large volumes of data and produce models that are uninterpretable to humans. An…

Artificial Intelligence · Computer Science 2025-05-06 Nolan P Shaw , P Michael Furlong , Britt Anderson , Jeff Orchard

Vector Symbolic Architectures (VSAs) provide a well-defined algebraic framework for compositional representations in hyperdimensional spaces. We introduce HyperSpace, an open-source framework that decomposes VSA systems into modular…

Artificial Intelligence · Computer Science 2026-05-12 Shay Snyder , Andrew Capodieci , David Gorsich , Maryam Parsa

Image-to-image translation has played an important role in enabling synthetic data for computer vision. However, if the source and target domains have a large semantic mismatch, existing techniques often suffer from source content…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Justin Theiss , Jay Leverett , Daeil Kim , Aayush Prakash

We investigate the task of retrieving information from compositional distributed representations formed by Hyperdimensional Computing/Vector Symbolic Architectures and present novel techniques which achieve new information rate bounds.…

Neural and Evolutionary Computing · Computer Science 2023-05-29 Denis Kleyko , Connor Bybee , Ping-Chen Huang , Christopher J. Kymn , Bruno A. Olshausen , E. Paxon Frady , Friedrich T. Sommer

This two-part comprehensive survey is devoted to a computing framework most commonly known under the names Hyperdimensional Computing and Vector Symbolic Architectures (HDC/VSA). Both names refer to a family of computational models that use…

Artificial Intelligence · Computer Science 2023-08-02 Denis Kleyko , Dmitri A. Rachkovskij , Evgeny Osipov , Abbas Rahimi

Image hash algorithms generate compact binary representations that can be quickly matched by Hamming distance, thus become an efficient solution for large-scale image retrieval. This paper proposes RV-SSDH, a deep image hash algorithm that…

Computer Vision and Pattern Recognition · Computer Science 2020-02-07 Li Weng , Lingzhi Ye , Jiangmin Tian , Jiuwen Cao , Jianzhong Wang

In abstract visual reasoning, monolithic deep learning models suffer from limited interpretability and generalization, while existing neuro-symbolic approaches fall short in capturing the diversity and systematicity of attributes and…

Artificial Intelligence · Computer Science 2025-01-23 Zhong-Hua Sun , Ru-Yuan Zhang , Zonglei Zhen , Da-Hui Wang , Yong-Jie Li , Xiaohong Wan , Hongzhi You

Transformer-based language models display impressive reasoning-like behavior, yet remain brittle on tasks that require stable symbolic manipulation. This paper develops a unified perspective on these phenomena by interpreting self-attention…

Artificial Intelligence · Computer Science 2025-12-18 Sahil Rajesh Dhayalkar

Hyperdimensional Computing (HDC) is an emerging computational paradigm for representing compositional information as high-dimensional vectors, and has a promising potential in applications ranging from machine learning to neuromorphic…

Information Theory · Computer Science 2024-03-07 Netanel Raviv

We study neural image compression based on the Sparse Visual Representation (SVR), where images are embedded into a discrete latent space spanned by learned visual codebooks. By sharing codebooks with the decoder, the encoder transfers…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Wei Jiang , Wei Wang , Yue Chen

Vector Symbolic Architecture (VSA) is emerging in machine learning due to its efficiency, but they are hindered by issues of hyperdimensionality and accuracy. As a promising mitigation, the Low-Dimensional Computing (LDC) method…

Machine Learning · Computer Science 2025-03-18 Shijin Duan , Yejia Liu , Gaowen Liu , Ramana Rao Kompella , Shaolei Ren , Xiaolin Xu

Analyzing a visual scene by inferring the configuration of a generative model is widely considered the most flexible and generalizable approach to scene understanding. Yet, one major problem is the computational challenge of the inference…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Alpha Renner , Lazar Supic , Andreea Danielescu , Giacomo Indiveri , Bruno A. Olshausen , Yulia Sandamirskaya , Friedrich T. Sommer , E. Paxon Frady

Abstract reasoning is a cornerstone of human intelligence, and replicating it with artificial intelligence (AI) presents an ongoing challenge. This study focuses on efficiently solving Raven's progressive matrices (RPM), a visual test for…

Machine Learning · Computer Science 2024-01-30 Michael Hersche , Francesco di Stefano , Thomas Hofmann , Abu Sebastian , Abbas Rahimi

The automation of user interface development has the potential to accelerate software delivery by mitigating intensive manual implementation. Despite the advancements in Large Multimodal Models for design-to-code translation, existing…

Information Retrieval · Computer Science 2025-12-24 Xian Wu , Ming Zhang , Zhiyu Fang , Fei Li , Bin Wang , Yong Jiang , Hao Zhou

A computational bottleneck in current Vector-Symbolic Architectures (VSAs) is the ``clean-up'' step, which decodes the noisy vectors retrieved from the architecture. Clean-up typically compares noisy vectors against a ``codebook'' of…

Data Structures and Algorithms · Computer Science 2025-06-23 Ruipeng Liu , Qinru Qiu , Simon Khan , Garrett E. Katz

Combined, joint, intra-governmental, inter-agency and multinational (CJIIM) operations require rapid data sharing without the bottlenecks of metadata curation and alignment. Curation and alignment is particularly infeasible for external…

Information Retrieval · Computer Science 2024-08-21 Cai Davies , Sam Meek , Philip Hawkins , Benomy Tutcher , Graham Bent , Alun Preece

We propose an approach to symbolic regression based on a novel variational autoencoder for generating hierarchical structures, HVAE. It combines simple atomic units with shared weights to recursively encode and decode the individual nodes…

Machine Learning · Computer Science 2023-09-12 Sebastian Mežnar , Sašo Džeroski , Ljupčo Todorovski