English
Related papers

Related papers: Capacity Analysis of Vector Symbolic Architectures

200 papers

Hyperdimensional computing (HDC) is a paradigm for data representation and learning originating in computational neuroscience. HDC represents data as high-dimensional, low-precision vectors which can be used for a variety of information…

Motivated by recent innovations in biologically-inspired neuromorphic hardware, this article presents a novel unsupervised machine learning algorithm named Hyperseed that draws on the principles of Vector Symbolic Architectures (VSA) for…

Artificial Intelligence · Computer Science 2022-09-30 Evgeny Osipov , Sachin Kahawala , Dilantha Haputhanthri , Thimal Kempitiya , Daswin De Silva , Damminda Alahakoon , Denis Kleyko

We present HyperSeg, a hyperdimensional computing (HDC) approach to unsupervised dialogue topic segmentation. HDC is a class of vector symbolic architectures that leverages the probabilistic orthogonality of randomly drawn vectors at…

Computation and Language · Computer Science 2023-08-22 Seongmin Park , Jinkyu Seo , Jihwa Lee

Hyperdimensional computing (HDC) has emerged as a new light-weight learning algorithm with smaller computation and energy requirements compared to conventional techniques. In HDC, data points are represented by high-dimensional vectors…

Machine Learning · Computer Science 2021-03-12 Toygun Basaklar , Yigit Tuncel , Shruti Yadav Narayana , Suat Gumussoy , Umit Y. Ogras

Hyperdimensional Computing (HDC) is a brain-inspired computing paradigm that represents and manipulates information using high-dimensional vectors, called hypervectors (HV). Traditional HDC methods, while robust to noise and inherently…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-12 Dhruv Parikh , Viktor Prasanna

Advances in bioinformatics are primarily due to new algorithms for processing diverse biological data sources. While sophisticated alignment algorithms have been pivotal in analyzing biological sequences, deep learning has substantially…

Hyperdimensional computing (HDC) is a novel computational paradigm that operates on long-dimensional vectors known as hypervectors. The hypervectors are constructed as long bit-streams and form the basic building blocks of HDC systems. In…

Hardware Architecture · Computer Science 2023-11-21 Sercan Aygun , Mehran Shoushtari Moghadam , M. Hassan Najafi

Hyperdimensional computing (HDC) is an emerging computing paradigm that represents, manipulates, and communicates data using very long random vectors (aka hypervectors). Among different hardware platforms capable of executing HDC…

Hardware Architecture · Computer Science 2022-05-24 Robert Guirado , Abbas Rahimi , Geethan Karunaratne , Eduard Alarcón , Abu Sebastian , Sergi Abadal

Vector Symbolic Architectures (VSAs) give a way to represent a complex object as a single fixed-length vector, so that similar objects have similar vector representations. These vector representations then become easy to use for machine…

Machine Learning · Computer Science 2022-02-11 Stephen I. Gallant

In abstract visual reasoning, monolithic deep learning models suffer from limited interpretability and generalization, while existing neuro-symbolic approaches fall short in capturing the diversity and systematicity of attributes and…

Artificial Intelligence · Computer Science 2025-01-23 Zhong-Hua Sun , Ru-Yuan Zhang , Zonglei Zhen , Da-Hui Wang , Yong-Jie Li , Xiaohong Wan , Hongzhi You

The ability to encode and manipulate data structures with distributed neural representations could qualitatively enhance the capabilities of traditional neural networks by supporting rule-based symbolic reasoning, a central property of…

Computer Vision and Pattern Recognition · Computer Science 2020-07-09 E. Paxon Frady , Spencer Kent , Bruno A. Olshausen , Friedrich T. Sommer

Multiple Instance Learning (MIL) tasks impose a strict logical constraint: a bag is labeled positive if and only if at least one instance within it is positive. While this iff constraint aligns with many real-world applications, recent work…

Machine Learning · Computer Science 2025-11-24 Ehsan Ahmed Dhrubo , Mohammad Mahmudul Alam , Edward Raff , Tim Oates , James Holt

Understanding the general priniciples behind transformer models remains a complex endeavor. Experiments with probing and disentangling features using sparse autoencoders (SAE) suggest that these models might manage linear features embedded…

Machine Learning · Computer Science 2024-12-12 Johannes Knittel , Tushaar Gangavarapu , Hendrik Strobelt , Hanspeter Pfister

Combined, joint, intra-governmental, inter-agency and multinational (CJIIM) operations require rapid data sharing without the bottlenecks of metadata curation and alignment. Curation and alignment is particularly infeasible for external…

Information Retrieval · Computer Science 2024-08-21 Cai Davies , Sam Meek , Philip Hawkins , Benomy Tutcher , Graham Bent , Alun Preece

Hyperdimensional computing (HDC) is an increasingly popular computing paradigm with immense potential for future intelligent applications. Although the main ideas already took form in the 1990s, HDC recently gained significant attention,…

Machine Learning · Computer Science 2023-11-15 Pieter Dewulf , Bernard De Baets , Michiel Stock

Brain-inspired hyperdimensional (HD) computing models neural activity patterns of the very size of the brain's circuits with points of a hyperdimensional space, that is, with hypervectors. Hypervectors are $D$-dimensional (pseudo)random…

Emerging Technologies · Computer Science 2019-04-04 Manuel Schmuck , Luca Benini , Abbas Rahimi

Publicly available collections of drug-like molecules have grown to comprise 10s of billions of possibilities in recent history due to advances in chemical synthesis. Traditional methods for identifying "hit" molecules from a large…

Hyperdimensional computing (HDC) is an emerging computing paradigm that exploits the distributed representation of input data in a hyperdimensional space, the dimensions of which are typically between 1,000--10,000. The hyperdimensional…

Signal Processing · Electrical Eng. & Systems 2024-02-01 Kei Kitagawa , Kohei Tsuji , Koyo Sagehashi , Tomoaki Niiyama , Satoshi Sunada

Representing meaning in the form of high dimensional vectors is a common and powerful tool in biologically inspired architectures. While the meaning of a set of concepts can be summarized by taking a (possibly weighted) sum of their…

Artificial Intelligence · Computer Science 2018-09-25 Douglas Summers-Stay , Peter Sutor , Dandan Li

Hyperdimensional computing (HDC) is a brain-inspired computing paradigm based on high-dimensional holistic representations of vectors. It recently gained attention for embedded smart sensing due to its inherent error-resiliency and…

Signal Processing · Electrical Eng. & Systems 2021-02-05 Manuel Eggimann , Abbas Rahimi , Luca Benini