中文
相关论文

相关论文: Algorithmic insights on continual learning from fr…

200 篇论文

We present a model of an olfactory system that performs odor segmentation. Based on the anatomy and physiology of natural olfactory systems, it consists of a pair of coupled modules, bulb and cortex. The bulb encodes the odor inputs as…

无序系统与神经网络 · 物理学 2007-05-23 Zhaoping Li , John Hertz

Continual learning of new knowledge over time is one desirable capability for intelligent systems to recognize more and more classes of objects. Without or with very limited amount of old data stored, an intelligent system often…

计算机视觉与模式识别 · 计算机科学 2021-04-29 Zhuoyun Li , Changhong Zhong , Sijia Liu , Ruixuan Wang , Wei-Shi Zheng

Inspired by the fruit-fly olfactory circuit, the Fly Bloom Filter [Dasgupta et al., 2018] is able to efficiently summarize the data with a single pass and has been used for novelty detection. We propose a new classifier (for binary and…

机器学习 · 计算机科学 2020-08-21 Kaushik Sinha , Parikshit Ram

Quantum computers may outperform classical computers on machine learning tasks. In recent years, a variety of quantum algorithms promising unparalleled potential to enhance, speed up, or innovate machine learning have been proposed. Yet,…

Storing memory for molecular recognition is an efficient strategy for responding to external stimuli. Biological processes use different strategies to store memory. In the olfactory cortex, synaptic connections form when stimulated by an…

生物物理 · 物理学 2021-06-07 Oskar H Schnaack , Luca Peliti , Armita Nourmohammad

Despite advances in deep learning, neural networks can only learn multiple tasks when trained on them jointly. When tasks arrive sequentially, they lose performance on previously learnt tasks. This phenomenon called catastrophic forgetting…

机器学习 · 计算机科学 2018-05-29 Nitin Kamra , Umang Gupta , Yan Liu

In lifelong learning systems based on artificial neural networks, one of the biggest obstacles is the inability to retain old knowledge as new information is encountered. This phenomenon is known as catastrophic forgetting. In this paper,…

机器学习 · 计算机科学 2022-08-16 Alexander Ororbia , Ankur Mali , Daniel Kifer , C. Lee Giles

Despite the progress in deep learning networks, efficient learning at the edge (enabling adaptable, low-complexity machine learning solutions) remains a critical need for defense and commercial applications. We envision a pipeline to…

We present a neural algorithm for the rapid online learning and identification of odorant samples under noise, based on the architecture of the mammalian olfactory bulb and implemented on the Intel Loihi neuromorphic system. As with…

神经与进化计算 · 计算机科学 2020-05-26 Nabil Imam , Thomas A. Cleland

Recent advances in associative memory design through structured pattern sets and graph-based inference algorithms have allowed reliable learning and recall of an exponential number of patterns. Although these designs correct external errors…

神经与进化计算 · 计算机科学 2014-03-14 Amin Karbasi , Amir Hesam Salavati , Amin Shokrollahi , Lav R. Varshney

Deep neural networks are used in many state-of-the-art systems for machine perception. Once a network is trained to do a specific task, e.g., bird classification, it cannot easily be trained to do new tasks, e.g., incrementally learning to…

人工智能 · 计算机科学 2017-11-10 Ronald Kemker , Marc McClure , Angelina Abitino , Tyler Hayes , Christopher Kanan

Identifying quantum flakes is crucial for scalable quantum hardware; however, automated layer classification from optical microscopy remains challenging due to substantial appearance shifts across different materials. This paper proposes a…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Sankalp Pandey , Xuan Bac Nguyen , Nicholas Borys , Hugh Churchill , Khoa Luu

Federated Learning has been introduced as a new machine learning paradigm enhancing the use of local devices. At a server level, FL regularly aggregates models learned locally on distributed clients to obtain a more general model. Current…

机器学习 · 计算机科学 2022-07-19 Anastasiia Usmanova , François Portet , Philippe Lalanda , German Vega

Humans excel at continually acquiring, consolidating, and retaining information from an ever-changing environment, whereas artificial neural networks (ANNs) exhibit catastrophic forgetting. There are considerable differences in the…

神经与进化计算 · 计算机科学 2023-04-17 Fahad Sarfraz , Elahe Arani , Bahram Zonooz

Tracking a turbulent plume to locate its source is a complex control problem because it requires multi-sensory integration and must be robust to intermittent odors, changing wind direction, and variable plume statistics. This task is…

神经元与认知 · 定量生物学 2021-12-21 Satpreet Harcharan Singh , Floris van Breugel , Rajesh P. N. Rao , Bingni Wen Brunton

Continual learning is crucial for creating AI agents that can learn and improve themselves autonomously. A primary challenge in continual learning is to learn new tasks without losing previously learned knowledge. Current continual learning…

机器学习 · 计算机科学 2025-03-18 Amin Banayeeanzade , Mohammad Rostami

Neuromorphic computing is one of the few current approaches that have the potential to significantly reduce power consumption in Machine Learning and Artificial Intelligence. Imam & Cleland presented an odour-learning algorithm that runs on…

神经与进化计算 · 计算机科学 2023-09-22 Nik Dennler , André van Schaik , Michael Schmuker

With the explosive growth of data, continual learning capability is increasingly important for neural networks. Due to catastrophic forgetting, neural networks inevitably forget the knowledge of old tasks after learning new ones. In visual…

机器学习 · 计算机科学 2024-02-26 Shengyang Huang , Jianwen Mo

Resistive memory (RM) based neuromorphic systems can emulate synaptic plasticity and thus support continual learning, but they generally lack biologically inspired mechanisms for active forgetting, which are critical for meeting modern data…

Machine learning recently proved efficient in learning differential equations and dynamical systems from data. However, the data is commonly assumed to originate from a single never-changing system. In contrast, when modeling real-world…

机器学习 · 计算机科学 2022-06-28 Leonard Bereska , Efstratios Gavves