中文
相关论文

相关论文: Targeted Forgetting and False Memory Formation in …

200 篇论文

Catastrophic forgetting refers to the tendency that a neural network "forgets" the previous learned knowledge upon learning new tasks. Prior methods have been focused on overcoming this problem on convolutional neural networks (CNNs), where…

机器学习 · 计算机科学 2020-12-14 Huihui Liu , Yiding Yang , Xinchao Wang

The lifelong learning paradigm in machine learning is an attractive alternative to the more prominent isolated learning scheme not only due to its resemblance to biological learning but also its potential to reduce energy waste by obviating…

机器学习 · 计算机科学 2023-08-30 Sanket Vaibhav Mehta , Darshan Patil , Sarath Chandar , Emma Strubell

Existing Continual Learning (CL) approaches have focused on addressing catastrophic forgetting by leveraging regularization methods, replay buffers, and task-specific components. However, realistic CL solutions must be shaped not only by…

机器学习 · 计算机科学 2023-10-11 Jinyung Hong , Theodore P. Pavlic

In this work, we initiate a formal study of probably approximately correct (PAC) learning under evasion attacks, where the adversary's goal is to \emph{misclassify} the adversarially perturbed sample point $\widetilde{x}$, i.e.,…

机器学习 · 计算机科学 2019-06-14 Dimitrios I. Diochnos , Saeed Mahloujifar , Mohammad Mahmoody

In recent years, deep learning has shown itself to be an incredibly valuable tool in cybersecurity as it helps network intrusion detection systems to classify attacks and detect new ones. Adversarial learning is the process of utilizing…

密码学与安全 · 计算机科学 2022-06-30 Jared Mathews , Prosenjit Chatterjee , Shankar Banik , Cory Nance

In lifelong learning systems based on artificial neural networks, one of the biggest obstacles is the inability to retain old knowledge as new information is encountered. This phenomenon is known as catastrophic forgetting. In this paper,…

机器学习 · 计算机科学 2022-08-16 Alexander Ororbia , Ankur Mali , Daniel Kifer , C. Lee Giles

Backdoor attack intends to embed hidden backdoor into deep neural networks (DNNs), so that the attacked models perform well on benign samples, whereas their predictions will be maliciously changed if the hidden backdoor is activated by…

密码学与安全 · 计算机科学 2022-02-17 Yiming Li , Yong Jiang , Zhifeng Li , Shu-Tao Xia

The core challenge with continual learning is catastrophic forgetting, the phenomenon that when neural networks are trained on a sequence of tasks they rapidly forget previously learned tasks. It has been observed that catastrophic…

机器学习 · 计算机科学 2020-09-10 Mark Collier , Efi Kokiopoulou , Andrea Gesmundo , Jesse Berent

Catastrophic forgetting (CF) happens whenever a neural network overwrites past knowledge while being trained on new tasks. Common techniques to handle CF include regularization of the weights (using, e.g., their importance on past tasks),…

机器学习 · 计算机科学 2022-12-29 Jary Pomponi , Simone Scardapane , Aurelio Uncini

Catastrophic forgetting and capacity saturation are the central challenges of any parametric lifelong learning system. In this work, we study these challenges in the context of sequential supervised learning with an emphasis on recurrent…

机器学习 · 计算机科学 2019-09-10 Shagun Sodhani , Sarath Chandar , Yoshua Bengio

Continual learning-the ability to learn many tasks in sequence-is critical for artificial learning systems. Yet standard training methods for deep networks often suffer from catastrophic forgetting, where learning new tasks erases knowledge…

机器学习 · 统计学 2021-07-12 Sebastian Lee , Sebastian Goldt , Andrew Saxe

Catastrophic forgetting (CF) happens whenever a neural network overwrites past knowledge while being trained on new tasks. Common techniques to handle CF include regularization of the weights (using, e.g., their importance on past tasks),…

机器学习 · 统计学 2021-08-06 Jary Pomponi , Simone Scardapane , Aurelio Uncini

Approaches to continual learning aim to successfully learn a set of related tasks that arrive in an online manner. Recently, several frameworks have been developed which enable deep learning to be deployed in this learning scenario. A key…

机器学习 · 统计学 2020-06-17 Tameem Adel , Han Zhao , Richard E. Turner

Continual learning on sequential data is critical for many machine learning (ML) deployments. Unfortunately, LSTM networks, which are commonly used to learn on sequential data, suffer from catastrophic forgetting and are limited in their…

机器学习 · 计算机科学 2023-05-30 Ketaki Joshi , Raghavendra Pradyumna Pothukuchi , Andre Wibisono , Abhishek Bhattacharjee

In this work, we show how to jointly exploit adversarial perturbation and model poisoning vulnerabilities to practically launch a new stealthy attack, dubbed AdvTrojan. AdvTrojan is stealthy because it can be activated only when: 1) a…

密码学与安全 · 计算机科学 2021-09-06 Guanxiong Liu , Issa Khalil , Abdallah Khreishah , NhatHai Phan

When a computational system continuously learns from an ever-changing environment, it rapidly forgets its past experiences. This phenomenon is called catastrophic forgetting. While a line of studies has been proposed with respect to…

Generally intelligent agents exhibit successful behavior across problems in several settings. Endemic in approaches to realize such intelligence in machines is catastrophic forgetting: sequential learning corrupts knowledge obtained earlier…

人工智能 · 计算机科学 2018-04-13 Shawn L. E. Beaulieu , Sam Kriegman , Josh C. Bongard

In spite of the enormous success of neural networks, adversarial examples remain a relatively weakly understood feature of deep learning systems. There is a considerable effort in both building more powerful adversarial attacks and…

机器学习 · 计算机科学 2022-08-16 Maciej Żelaszczyk , Jacek Mańdziuk

In the present era of deep learning, continual learning research is mainly focused on mitigating forgetting when training a neural network with stochastic gradient descent on a non-stationary stream of data. On the other hand, in the more…

机器学习 · 计算机科学 2024-05-30 Soochan Lee , Hyeonseong Jeon , Jaehyeon Son , Gunhee Kim

In real life, adversarial attack to deep learning models is a fatal security issue. However, the issue has been rarely discussed in a widely used class-incremental continual learning (CICL). In this paper, we address problems of applying…

机器学习 · 计算机科学 2023-05-24 Minchan Kwon , Kangil Kim