English
Related papers

Related papers: Lifelong Intelligence Beyond the Edge using Hyperd…

200 papers

Alcohol consumption has a significant impact on individuals' health, with even more pronounced consequences when consumption becomes excessive. One approach to promoting healthier drinking habits is implementing just-in-time interventions,…

Drawing inspiration from the outstanding learning capability of our human brains, Hyperdimensional Computing (HDC) emerges as a novel computing paradigm, and it leverages high-dimensional vector presentation and operations for brain-like…

Lifelong Learning (LL) refers to the ability to continually learn and solve new problems with incremental available information over time while retaining previous knowledge. Much attention has been given lately to Supervised Lifelong…

Machine Learning · Computer Science 2021-06-17 Tingting Zhao , Zifeng Wang , Aria Masoomi , Jennifer Dy

On-device inference holds great potential for increased energy efficiency, responsiveness, and privacy in edge ML systems. However, due to less capable ML models that can be embedded in resource-limited devices, use cases are limited to…

In lifelong learning, data are used to improve performance not only on the present task, but also on past and future (unencountered) tasks. While typical transfer learning algorithms can improve performance on future tasks, their…

Motivated by the proliferation of Internet-of-Thing (IoT) devices and the rapid advances in the field of deep learning, there is a growing interest in pushing deep learning computations, conventionally handled by the cloud, to the edge of…

Machine Learning · Computer Science 2024-09-25 Marco Palena , Tania Cerquitelli , Carla Fabiana Chiasserini

Meta-Continual Learning (Meta-CL) enables models to learn new classes from limited labelled samples, making it promising for IoT applications where manual labelling is costly. However, existing studies focus on accuracy while ignoring…

Machine Learning · Computer Science 2026-01-27 Sijia Li , Young D. Kwon , Lik-Hang Lee , Pan Hui

Conventional Intent Detection (ID) models are usually trained offline, which relies on a fixed dataset and a predefined set of intent classes. However, in real-world applications, online systems usually involve continually emerging new user…

Computation and Language · Computer Science 2021-08-11 Qingbin Liu , Xiaoyan Yu , Shizhu He , Kang Liu , Jun Zhao

Resource-constrained Edge Devices (EDs), e.g., IoT sensors and microcontroller units, are expected to make intelligent decisions using Deep Learning (DL) inference at the edge of the network. Toward this end, there is a significant research…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-25 Ghina Al-Atat , Andrea Fresa , Adarsh Prasad Behera , Vishnu Narayanan Moothedath , James Gross , Jaya Prakash Champati

Continual learning (CL) trains NN models incrementally from a continuous stream of tasks. To remember previously learned knowledge, prior studies store old samples over a memory hierarchy and replay them when new tasks arrive. Edge devices…

Machine Learning · Computer Science 2023-12-06 Xinyue Ma , Suyeon Jeong , Minjia Zhang , Di Wang , Jonghyun Choi , Myeongjae Jeon

Edge learning facilitates ubiquitous intelligence by enabling model training and adaptation directly on data-generating devices, thereby mitigating privacy risks and communication latency. However, the high computational and energy overhead…

Machine Learning · Computer Science 2026-02-03 Laha Ale , Hu Luo , Mingsheng Cao , Shichao Li , Huanlai Xing , Haifeng Sun

Hyperdimensional computing (HDC) is a method to perform classification that uses binary vectors with high dimensions and the majority rule. This approach has the potential to be energy-efficient and hence deemed suitable for…

Machine Learning · Computer Science 2023-10-13 Zhanglu Yan , Shida Wang , Kaiwen Tang , Weng-Fai Wong

Hyperdimensional computing (HDC) offers lightweight learning for energy-constrained devices by encoding data into high-dimensional vectors. However, its reliance on ultra-high dimensionality and static, randomly initialized hypervectors…

Machine Learning · Computer Science 2026-02-03 Hanne Dejonghe , Sam Leroux

Semi-supervised anomaly detection is an approach to identify anomalies by learning the distribution of normal data. Backpropagation neural networks (i.e., BP-NNs) based approaches have recently drawn attention because of their good…

Machine Learning · Computer Science 2020-02-04 Mineto Tsukada , Masaaki Kondo , Hiroki Matsutani

While numerous methods achieving remarkable performance exist in the Object Detection literature, addressing data distribution shifts remains challenging. Continual Learning (CL) offers solutions to this issue, enabling models to adapt to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Francesco Pasti , Marina Ceccon , Davide Dalle Pezze , Francesco Paissan , Elisabetta Farella , Gian Antonio Susto , Nicola Bellotto

In the past decades, spectral clustering (SC) has become one of the most effective clustering algorithms. However, most previous studies focus on spectral clustering tasks with a fixed task set, which cannot incorporate with a new spectral…

Machine Learning · Computer Science 2019-12-02 Gan Sun , Yang Cong , Qianqian Wang , Jun Li , Yun Fu

This literature review explores continual learning methods for on-device training in the context of neural networks (NNs) and decision trees (DTs) for classification tasks on smart environments. We highlight key constraints, such as data…

Machine Learning · Computer Science 2025-02-26 Afonso Lourenço , João Rodrigo , João Gama , Goreti Marreiros

Hyperdimensional computing (HDC) is an emerging computing paradigm that imitates the brain's structure to offer a powerful and efficient processing and learning model. In HDC, the data are encoded with long vectors, called hypervectors,…

Machine Learning · Computer Science 2023-08-02 Sercan Aygun , Mehran Shoushtari Moghadam , M. Hassan Najafi , Mohsen Imani

Hyperdimensional Computing (HDC) has obtained abundant attention as an emerging non von Neumann computing paradigm. Inspired by the way human brain functions, HDC leverages high dimensional patterns to perform learning tasks. Compared to…

Neural and Evolutionary Computing · Computer Science 2022-07-27 Dongning Ma , Xun Jiao

This paper introduces a new lifelong learning solution where a single model is trained for a sequence of tasks. The main challenge that vision systems face in this context is catastrophic forgetting: as they tend to adapt to the most…

Computer Vision and Pattern Recognition · Computer Science 2018-07-19 Amal Rannen Triki , Rahaf Aljundi , Mathew B. Blaschko , Tinne Tuytelaars