English
Related papers

Related papers: On-device Synaptic Memory Consolidation using Fowl…

200 papers

In this paper, we develop an in-memory analog computing (IMAC) architecture realizing both synaptic behavior and activation functions within non-volatile memory arrays. Spin-orbit torque magnetoresistive random-access memory (SOT-MRAM)…

Hardware Architecture · Computer Science 2021-09-15 Mohammed Elbtity , Abhishek Singh , Brendan Reidy , Xiaochen Guo , Ramtin Zand

Federated learning allows edge devices to collaboratively learn a shared model while keeping the training data on device, decoupling the ability to do model training from the need to store the data in the cloud. We propose Federated matched…

Machine Learning · Computer Science 2020-02-18 Hongyi Wang , Mikhail Yurochkin , Yuekai Sun , Dimitris Papailiopoulos , Yasaman Khazaeni

Existing deep convolutional neural networks (CNNs) generate massive interlayer feature data during network inference. To maintain real-time processing in embedded systems, large on-chip memory is required to buffer the interlayer feature…

Hardware Architecture · Computer Science 2021-10-13 Zhuang Shao , Xiaoliang Chen , Li Du , Lei Chen , Yuan Du , Wei Zhuang , Huadong Wei , Chenjia Xie , Zhongfeng Wang

Conventionally, DNN models are trained once in the cloud and deployed in edge devices such as cars, robots, or unmanned aerial vehicles (UAVs) for real-time inference. However, there are many cases that require the models to adapt to new…

Machine Learning · Computer Science 2022-02-23 Yue Tang , Xinyi Zhang , Peipei Zhou , Jingtong Hu

Real-time tracking of high-speed objects in cognitive tasks is challenging in the present artificial intelligence techniques because the data processing and computation are time-consuming resulting in impeditive time delays. A…

Applied Physics · Physics 2020-11-05 Qi Zheng , Yuanyuan Mi , Xiaorui Zhu , Zhe Yuan , Ke Xia

Convolutional neural networks (CNNs) are one of the most successful machine learning techniques for image, voice and video processing. CNNs require large amounts of processing capacity and memory bandwidth. Hardware accelerators have been…

Hardware Architecture · Computer Science 2018-05-03 James Garland , David Gregg

In this work we develop a model of predictive learning on neuromorphic hardware. Our model uses the on-chip plasticity capabilities of the Loihi chip to remember observed sequences of events and use this memory to generate predictions of…

Neural and Evolutionary Computing · Computer Science 2022-05-03 Jack Lindsey , James B Aimone

Neural networks encounter the challenge of Catastrophic Forgetting (CF) in continual learning, where new task learning interferes with previously learned knowledge. Existing data fine-tuning and regularization methods necessitate task…

Machine Learning · Computer Science 2024-05-17 Yuwei Sun , Ippei Fujisawa , Arthur Juliani , Jun Sakuma , Ryota Kanai

The brain, which uses redundancy and continuous learning to overcome the unreliability of its components, provides a promising path to building computing systems that are robust to the unreliability of their constituent nanodevices. In this…

Emerging Technologies · Computer Science 2018-10-17 Alice Mizrahi , Julie Grollier , Damien Querlioz , M. D. Stiles

Multi-view sequential learning is a fundamental problem in machine learning dealing with multi-view sequences. In a multi-view sequence, there exists two forms of interactions between different views: view-specific interactions and…

Machine Learning · Computer Science 2018-02-06 Amir Zadeh , Paul Pu Liang , Navonil Mazumder , Soujanya Poria , Erik Cambria , Louis-Philippe Morency

Continual learning in natural language processing plays a crucial role in adapting to evolving data and preventing catastrophic forgetting. Despite significant progress, existing methods still face challenges, such as inefficient parameter…

Machine Learning · Computer Science 2026-02-04 Min Zeng , Xi Chen , Haiqin Yang , Yike Guo

Federated learning (FL) promotes decentralized training while prioritizing data confidentiality. However, its application on resource-constrained devices is challenging due to the high demand for computation and memory resources to train…

Machine Learning · Computer Science 2024-03-25 Hong Huang , Weiming Zhuang , Chen Chen , Lingjuan Lyu

Although Federated Learning (FL) enables collaborative learning in Artificial Intelligence of Things (AIoT) design, it fails to work on low-memory AIoT devices due to its heavy memory usage. To address this problem, various federated…

Machine Learning · Computer Science 2024-05-09 Pengyu Zhang , Yingjie Liu , Yingbo Zhou , Xiao Du , Xian Wei , Ting Wang , Mingsong Chen

Quantum annealing machines based on superconducting qubits, which have the potential to solve optimization problems faster than digital computers, are of great interest not only to researchers but also to the general public. Here, we…

Quantum Physics · Physics 2018-10-22 T. Tanamoto , Y. Higashi , T. Marukame , J. Deguchi

Spiking Neural Networks (SNNs) have recently gained significant interest in on-chip learning in embedded devices and emerged as an energy-efficient alternative to conventional Artificial Neural Networks (ANNs). However, to extend SNNs to a…

Machine Learning · Computer Science 2024-09-20 Manh V. Nguyen , Liang Zhao , Bobin Deng , William Severa , Honghui Xu , Shaoen Wu

Efficiently encoding classical visual data into quantum states is essential for realizing practical quantum neural networks (QNNs). However, existing encoding schemes often discard spatial and semantic information when adapting…

Quantum Physics · Physics 2025-11-20 Yuhu Lu , Jinjing Shi

Neuromorphic computing and spiking neural networks (SNN) mimic the behavior of biological systems and have drawn interest for their potential to perform cognitive tasks with high energy efficiency. However, some factors such as temporal…

Hardware Architecture · Computer Science 2021-05-10 Haowen Fang , Brady Taylor , Ziru Li , Zaidao Mei , Hai Li , Qinru Qiu

Compute-in-memory (CIM) accelerators for spiking neural networks (SNNs) are promising solutions to enable $\mu$s-level inference latency and ultra-low energy in edge vision applications. Yet, their current lack of flexibility at both the…

Hardware Architecture · Computer Science 2024-10-31 Nicolas Chauvaux , Adrian Kneip , Christoph Posch , Kofi Makinwa , Charlotte Frenkel

Analog quantum optimization methods, such as quantum annealing, are promising and at least partially noise tolerant ways to solve hard optimization and sampling problems with quantum hardware. However, they have thus far failed to…

Mesoscale and Nanoscale Physics · Physics 2023-06-21 Gianni Mossi , Vadim Oganesyan , Eliot Kapit

Spiking Neural Networks (SNNs) have emerged as an attractive spatio-temporal computing paradigm for complex vision tasks. However, most existing works yield models that require many time steps and do not leverage the inherent temporal…

Neural and Evolutionary Computing · Computer Science 2022-10-25 Gourav Datta , Haoqin Deng , Robert Aviles , Peter A. Beerel