English
Related papers

Related papers: Learning and Unlearning: Bridging classification, …

200 papers

Exact unlearning was first introduced as a privacy mechanism that allowed a user to retract their data from machine learning models on request. Shortly after, inexact schemes were proposed to mitigate the impractical costs associated with…

Most deep learning models are limited to specific datasets or tasks because of network structures using fixed layers. In this paper, we discuss the differences between existing neural networks and real human neurons, propose association…

Artificial Intelligence · Computer Science 2023-01-31 Seokjun Kim , Jaeeun Jang , Hyeoncheol Kim

Humans and other animals are capable of improving their learning performance as they solve related tasks from a given problem domain, to the point of being able to learn from extremely limited data. While synaptic plasticity is generically…

Machine Learning · Computer Science 2022-10-04 Nicolas Zucchet , Simon Schug , Johannes von Oswald , Dominic Zhao , João Sacramento

Sequential learning of multiple tasks in artificial neural networks using gradient descent leads to catastrophic forgetting, whereby previously learned knowledge is erased during learning of new, disjoint knowledge. Here, we propose a…

Machine Learning · Computer Science 2019-06-26 Shixian Wen , Laurent Itti

There is a concerted effort to build domain-general artificial intelligence in the form of universal neural network models with sufficient computational flexibility to solve a wide variety of cognitive tasks but without requiring…

Neural and Evolutionary Computing · Computer Science 2023-03-27 Jascha Achterberg , Danyal Akarca , Moataz Assem , Moritz Heimbach , Duncan E. Astle , John Duncan

Biological evolution has distilled the experiences of many learners into the general learning algorithms of humans. Our novel meta reinforcement learning algorithm MetaGenRL is inspired by this process. MetaGenRL distills the experiences of…

Machine Learning · Computer Science 2020-02-17 Louis Kirsch , Sjoerd van Steenkiste , Jürgen Schmidhuber

Deep neural networks are powerful machines for visual pattern recognition, but reasoning tasks that are easy for humans may still be difficult for neural models. Humans possess the ability to extrapolate reasoning strategies learned on…

Machine Learning · Computer Science 2021-11-03 Avi Schwarzschild , Eitan Borgnia , Arjun Gupta , Furong Huang , Uzi Vishkin , Micah Goldblum , Tom Goldstein

Replay in neural networks involves training on sequential data with memorized samples, which counteracts forgetting of previous behavior caused by non-stationarity. We present a method where these auxiliary samples are generated on the fly,…

Machine Learning · Computer Science 2020-12-15 Xu Ji , Joao Henriques , Tinne Tuytelaars , Andrea Vedaldi

In recent years, representation learning has become the research focus of the machine learning community. Large-scale neural networks are a crucial step toward achieving general intelligence, with their success largely attributed to their…

Machine Learning · Computer Science 2025-04-22 Lifeng Gu

In recent years, machine learning neural network has penetrated deeply into people's life. As the price of convenience, people's private information also has the risk of disclosure. The "right to be forgotten" was introduced in a timely…

Machine Learning · Computer Science 2021-11-11 Kongyang Chen , Yiwen Wang , Yao Huang

Researchers have proposed that deep learning, which is providing important progress in a wide range of high complexity tasks, might inspire new insights into learning in the brain. However, the methods used for deep learning by artificial…

Neural and Evolutionary Computing · Computer Science 2019-07-03 Isabella Pozzi , Sander Bohté , Pieter Roelfsema

Human demonstrations can provide trustful samples to train reinforcement learning algorithms for robots to learn complex behaviors in real-world environments. However, obtaining sufficient demonstrations may be impractical because many…

Robotics · Computer Science 2020-10-16 Huixin Zhan , Feng Tao , Yongcan Cao

Error backpropagation is a highly effective mechanism for learning high-quality hierarchical features in deep networks. Updating the features or weights in one layer, however, requires waiting for the propagation of error signals from…

Neural and Evolutionary Computing · Computer Science 2017-11-21 Hesham Mostafa , Vishwajith Ramesh , Gert Cauwenberghs

We analyze algorithmic and computational aspects of biological phenomena, such as replication and programmed death, in the context of machine learning. We use two different measures of neuron efficiency to develop machine learning…

Neural and Evolutionary Computing · Computer Science 2022-07-12 Andrey Grabovsky , Vitaly Vanchurin

Artificial neural networks (ANNs) are typically confined to accomplishing pre-defined tasks by learning a set of static parameters. In contrast, biological neural networks (BNNs) can adapt to various new tasks by continually updating the…

Artificial Intelligence · Computer Science 2022-09-20 Fan Wang , Hao Tian , Haoyi Xiong , Hua Wu , Jie Fu , Yang Cao , Yu Kang , Haifeng Wang

Modern computer systems store vast amounts of personal data, enabling advances in AI and ML but risking user privacy and trust. For privacy reasons, it is sometimes desired for an ML model to forget part of the data it was trained on. In…

Machine Learning · Computer Science 2025-12-30 Amartya Hatua , Trung T. Nguyen , Filip Cano , Andrew H. Sung

Removing the influence of a specified subset of training data from a machine learning model may be required to address issues such as privacy, fairness, and data quality. Retraining the model from scratch on the remaining data after removal…

Machine Learning · Computer Science 2022-09-05 Salvatore Mercuri , Raad Khraishi , Ramin Okhrati , Devesh Batra , Conor Hamill , Taha Ghasempour , Andrew Nowlan

Recent success in training deep neural networks have prompted active investigation into the features learned on their intermediate layers. Such research is difficult because it requires making sense of non-linear computations performed by…

Machine Learning · Computer Science 2016-03-01 Yixuan Li , Jason Yosinski , Jeff Clune , Hod Lipson , John Hopcroft

Artificial neural networks took a lot of inspiration from their biological counterparts in becoming our best machine perceptual systems. This work summarizes some of that history and incorporates modern theoretical neuroscience into…

Neural and Evolutionary Computing · Computer Science 2022-09-12 Robert Bain

This article presents a new machine unlearning approach that utilizes multiple Generative Adversarial Network (GAN) based models. The proposed method comprises two phases: i) data reorganization in which synthetic data using the GAN model…

Machine Learning · Computer Science 2024-07-29 Amartya Hatua , Trung T. Nguyen , Andrew H. Sung