English
Related papers

Related papers: Efficient Vector Symbolic Architectures from Histo…

200 papers

Background / introduction. Vector symbolic architectures (VSA) are a viable approach for the hyperdimensional representation of symbolic data, such as documents, syntactic structures, or semantic frames. Methods. We present a rigorous…

Computation and Language · Computer Science 2020-09-28 Peter beim Graben , Markus Huber , Werner Meyer , Ronald Römer , Matthias Wolff

This article proposes the use of Vector Symbolic Architectures for implementing Hierarchical Graph Neuron, an architecture for memorizing patterns of generic sensor stimuli. The adoption of a Vector Symbolic representation ensures a…

Artificial Intelligence · Computer Science 2019-08-13 Denis Kleyko , Evgeny Osipov , Alexander Senior , Asad I. Khan , Y. Ahmet Şekercioğlu

The sequence reconstruction problem, introduced by Levenshtein in 2001, considers a communication setting in which a sender transmits a codeword and the receiver observes K independent noisy versions of this codeword. In this work, we study…

Information Theory · Computer Science 2026-01-16 Shubhransh Singhvi , Han Mao Kiah , Eitan Yaakobi

Speech is understood better by using visual context; for this reason, there have been many attempts to use images to adapt automatic speech recognition (ASR) systems. Current work, however, has shown that visually adapted ASR models only…

Computation and Language · Computer Science 2020-02-19 Tejas Srinivasan , Ramon Sanabria , Florian Metze

The image-based multimodal automatic speech recognition (ASR) model enhances speech recognition performance by incorporating audio-related image. However, some works suggest that introducing image information to model does not help…

Sound · Computer Science 2024-10-08 Jiliang Hu , Zuchao Li , Ping Wang , Haojun Ai , Lefei Zhang , Hai Zhao

High-dimensional vectors have been proposed as a neural method for representing information in the brain using Vector Symbolic Algebras (VSAs). While previous work has explored decoding and cleaning up these vectors under the noise that…

Neural and Evolutionary Computing · Computer Science 2024-12-03 Alicia Bremer , Jeff Orchard

Neural speech codecs aim to compress input signals into minimal bits while maintaining content quality in a low-latency manner. However, existing neural codecs often trade model complexity for reconstruction performance. These codecs…

Sound · Computer Science 2024-10-04 Yuzhe Gu , Enmao Diao

Higher-order singular value decomposition (HOSVD) is an efficient way for data reduction and also eliciting intrinsic structure of multi-dimensional array data. It has been used in many applications, and some of them involve incomplete…

Numerical Analysis · Mathematics 2016-08-11 Yangyang Xu

Hyperdimensional computing (HDC), also referred to as vector symbolic architectures (VSA), represents information with high-dimensional vectors and a compact algebra of primitives. This paper establishes an explicitly unitary embedding from…

Emerging Technologies · Computer Science 2026-04-28 Tyler L. Poore

The entorhinal-hippocampal formation is the mammalian brain's navigation system, encoding both physical and abstract spaces via grid cells. This system is well-studied in neuroscience, and its efficiency and versatility make it attractive…

Neural and Evolutionary Computing · Computer Science 2025-03-12 Sven Krausse , Emre Neftci , Friedrich T. Sommer , Alpha Renner

Following the initial publication of hdlib, a Python library for designing Vector-Symbolic Architectures (VSA), we introduce a major extension that significantly enhances its machine learning capabilities. VSA, also known as…

Machine Learning · Computer Science 2026-01-07 Fabio Cumbo , Kabir Dhillon , Daniel Blankenberg

We develop theoretical foundations of Resonator Networks, a new type of recurrent neural network introduced in Frady et al. (2020) to solve a high-dimensional vector factorization problem arising in Vector Symbolic Architectures. Given a…

Neural and Evolutionary Computing · Computer Science 2020-07-16 Spencer J. Kent , E. Paxon Frady , Friedrich T. Sommer , Bruno A. Olshausen

In this paper we propose novel methods for compression and recovery of multilinear data under limited sampling. We exploit the recently proposed tensor- Singular Value Decomposition (t-SVD)[1], which is a group theoretic framework for…

Information Theory · Computer Science 2013-11-01 Zemin Zhang , Gregory Ely , Shuchin Aeron , Ning Hao , Misha Kilmer

Visual speech recognition (VSR) systems decode spoken words from an input sequence using only the video data. Practical applications of such systems include medical assistance as well as human-machine interactions. A VSR system is typically…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Iason Ioannis Panagos , Giorgos Sfikas , Christophoros Nikou

Speed-of-sound has been shown as a potential biomarker for breast cancer imaging, successfully differentiating malignant tumors from benign ones. Speed-of-sound images can be reconstructed from time-of-flight measurements from ultrasound…

Image and Video Processing · Electrical Eng. & Systems 2020-07-23 Melanie Bernhardt , Valery Vishnevskiy , Richard Rau , Orcun Goksel

A key challenge in artificial intelligence and neuroscience is understanding how neural systems learn representations that capture the underlying dynamics of the world. Most world models represent the transition function with unstructured…

Machine Learning · Computer Science 2026-02-26 William Youngwoo Chung , Calvin Yeung , Hansen Jin Lillemark , Zhuowen Zou , Xiangjian Liu , Mohsen Imani

List recovery of error-correcting codes has emerged as a fundamental notion with broad applications across coding theory and theoretical computer science. Folded Reed-Solomon (FRS) and univariate multiplicity codes are explicit…

Information Theory · Computer Science 2025-12-10 Rohan Goyal , Venkatesan Guruswami

Visual Odometry (VO) is a method to estimate self-motion of a mobile robot using visual sensors. Unlike odometry based on integrating differential measurements that can accumulate errors, such as inertial sensors or wheel encoders, visual…

Effective speech representations for spoken language models must balance semantic relevance with acoustic fidelity for high-quality reconstruction. However, existing approaches struggle to achieve both simultaneously. To address this, we…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-03 Amir Hussein , Sameer Khurana , Gordon Wichern , Francois G. Germain , Jonathan Le Roux

Recovering analytical solutions of physical fields from visual observations is a fundamental yet underexplored capability for AI-assisted scientific reasoning. We study visual-to-symbolic analytical solution inference (ViSA) for…