English
Related papers

Related papers: A Theoretical Perspective on Hyperdimensional Comp…

200 papers

In the supervised learning domain, considering the recent prevalence of algorithms with high computational cost, the attention is steering towards simpler, lighter, and less computationally extensive training and inference approaches. In…

Machine Learning · Computer Science 2022-09-02 Antonello Rosato , Massimo Panella , Denis Kleyko

We introduce Residue Hyperdimensional Computing, a computing framework that unifies residue number systems with an algebra defined over random, high-dimensional vectors. We show how residue numbers can be represented as high-dimensional…

Neural and Evolutionary Computing · Computer Science 2023-11-09 Christopher J. Kymn , Denis Kleyko , E. Paxon Frady , Connor Bybee , Pentti Kanerva , Friedrich T. Sommer , Bruno A. Olshausen

Hyperdimensional computing (HDC) is a method to perform classification that uses binary vectors with high dimensions and the majority rule. This approach has the potential to be energy-efficient and hence deemed suitable for…

Machine Learning · Computer Science 2023-10-13 Zhanglu Yan , Shida Wang , Kaiwen Tang , Weng-Fai Wong

Hyperdimensional computing (HDC) has emerged as a new light-weight learning algorithm with smaller computation and energy requirements compared to conventional techniques. In HDC, data points are represented by high-dimensional vectors…

Machine Learning · Computer Science 2021-03-12 Toygun Basaklar , Yigit Tuncel , Shruti Yadav Narayana , Suat Gumussoy , Umit Y. Ogras

Thanks to the tiny storage and efficient execution, hyperdimensional Computing (HDC) is emerging as a lightweight learning framework on resource-constrained hardware. Nonetheless, the existing HDC training relies on various heuristic…

Machine Learning · Computer Science 2022-04-04 Shijin Duan , Yejia Liu , Shaolei Ren , Xiaolin Xu

While deep learning excels in natural image and language processing, its application to high-dimensional data faces computational challenges due to the dimensionality curse. Current large-scale data tools focus on business-oriented…

Machine Learning · Computer Science 2025-07-01 Chen Zhang

Hyperdimensional computing (HD) is an emerging paradigm for machine learning based on the evidence that the brain computes on high-dimensional, distributed, representations of data. The main operation of HD is encoding, which transfers the…

Machine Learning · Computer Science 2020-07-22 Behnam Khaleghi , Sahand Salamat , Anthony Thomas , Fatemeh Asgarinejad , Yeseong Kim , Tajana Rosing

Vector Symbolic Architectures (VSAs) are a powerful framework for representing compositional reasoning. They lend themselves to neural-network implementations, allowing us to create neural networks that can perform cognitive functions, like…

Neural and Evolutionary Computing · Computer Science 2023-03-02 Jeff Orchard , Russell Jarvis

The Internet of Things (IoT) has facilitated many applications utilizing edge-based machine learning (ML) methods to analyze locally collected data. Unfortunately, popular ML algorithms often require intensive computations beyond the…

Machine Learning · Computer Science 2023-11-15 Junyao Wang , Mohammad Abdullah Al Faruque

Hyperdimensional computing (HDC) offers lightweight learning for energy-constrained devices by encoding data into high-dimensional vectors. However, its reliance on ultra-high dimensionality and static, randomly initialized hypervectors…

Machine Learning · Computer Science 2026-02-03 Hanne Dejonghe , Sam Leroux

3D data is a valuable asset the computer vision filed as it provides rich information about the full geometry of sensed objects and scenes. Recently, with the availability of both large 3D datasets and computational power, it is today…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Eman Ahmed , Alexandre Saint , Abd El Rahman Shabayek , Kseniya Cherenkova , Rig Das , Gleb Gusev , Djamila Aouada , Bjorn Ottersten

A change of the prevalent supervised learning techniques is foreseeable in the near future: from the complex, computational expensive algorithms to more flexible and elementary training ones. The strong revitalization of randomized…

Machine Learning · Computer Science 2022-09-02 Antonello Rosato , Massimo Panella , Evgeny Osipov , Denis Kleyko

Machine learning models differ in terms of accuracy, computational/memory complexity, training time, and adaptability among other characteristics. For example, neural networks (NNs) are well-known for their high accuracy due to the quality…

Machine Learning · Computer Science 2020-08-05 Mahdi Nazemi , Amirhossein Esmaili , Arash Fayyazi , Massoud Pedram

Heterogeneous ultra-dense network (H-UDN) is envisioned as a promising solution to sustain the explosive mobile traffic demand through network densification. By placing access points, processors, and storage units as close as possible to…

Information Theory · Computer Science 2018-08-15 Congmin Fan , Ying-Jun Angela Zhang , Xiaojun Yuan

Hyperdimensional Computing (HDC) developed by Kanerva is a computational model for machine learning inspired by neuroscience. HDC exploits characteristics of biological neural systems such as high-dimensionality, randomness and a…

Machine Learning · Computer Science 2022-05-17 Igor Nunes , Mike Heddes , Tony Givargis , Alexandru Nicolau , Alex Veidenbaum

Hyperdimensional Computing (HDC) is an emerging computational paradigm for representing compositional information as high-dimensional vectors, and has a promising potential in applications ranging from machine learning to neuromorphic…

Information Theory · Computer Science 2024-03-07 Netanel Raviv

High-dimensional data and high-dimensional representations of reality are inherent features of modern Artificial Intelligence systems and applications of machine learning. The well-known phenomenon of the "curse of dimensionality" states:…

Machine Learning · Computer Science 2020-01-22 Alexander N. Gorban , Valery A. Makarov , Ivan Y. Tyukin

Smart manufacturing can significantly improve efficiency and reduce energy consumption, yet the energy demands of AI models may offset these gains. This study utilizes in-situ sensing-based prediction of geometric quality in smart machining…

Machine Learning · Computer Science 2025-12-04 Danny Hoang , Anandkumar Patel , Ruimen Chen , Rajiv Malhotra , Farhad Imani

Hypernetworks, or hypernets for short, are neural networks that generate weights for another neural network, known as the target network. They have emerged as a powerful deep learning technique that allows for greater flexibility,…

Machine Learning · Computer Science 2025-01-03 Vinod Kumar Chauhan , Jiandong Zhou , Ping Lu , Soheila Molaei , David A. Clifton

Hyperdimensional Computing (HDC) is a computation framework based on properties of high-dimensional random spaces. It is particularly useful for machine learning in resource-constrained environments, such as embedded systems and IoT, as it…

Machine Learning · Computer Science 2022-05-18 Igor Nunes , Mike Heddes , Tony Givargis , Alexandru Nicolau