English
Related papers

Related papers: Chained Tuning Leads to Biased Forgetting

200 papers

Large language models (LLMs) risk retaining unauthorized or sensitive information from their training data, which raises privacy concerns. LLM unlearning seeks to mitigate these risks by selectively removing specified data while maintaining…

Computation and Language · Computer Science 2025-05-29 Hwan Chang , Hwanhee Lee

A central challenge in developing versatile machine learning systems is catastrophic forgetting: a model trained on tasks in sequence will suffer significant performance drops on earlier tasks. Despite the ubiquity of catastrophic…

Machine Learning · Computer Science 2020-07-16 Vinay V. Ramasesh , Ethan Dyer , Maithra Raghu

Large Language Models (LLMs) have shown to be a great success in a wide range of applications ranging from regular NLP-based use cases to AI agents. LLMs have been trained on a vast corpus of texts from various sources; despite the best…

Computation and Language · Computer Science 2024-11-26 Abhinav Joshi , Shaswati Saha , Divyaksh Shukla , Sriram Vema , Harsh Jhamtani , Manas Gaur , Ashutosh Modi

Large language models (LLMs) have shown remarkable proficiency in generating text, benefiting from extensive training on vast textual corpora. However, LLMs may also acquire unwanted behaviors from the diverse and sensitive nature of their…

Computation and Language · Computer Science 2025-03-24 Zhiwei Zhang , Fali Wang , Xiaomin Li , Zongyu Wu , Xianfeng Tang , Hui Liu , Qi He , Wenpeng Yin , Suhang Wang

Large language models (LLMs) are capable of performing conditional sequence generation tasks, such as translation or summarization, through instruction fine-tuning. The fine-tuning data is generally sequentially concatenated from a specific…

Computation and Language · Computer Science 2023-08-24 Yijin Liu , Xianfeng Zeng , Fandong Meng , Jie Zhou

With the development of large language models (LLMs) like the GPT series, their widespread use across various application scenarios presents a myriad of challenges. This review initially explores the issue of domain specificity, where LLMs…

Computation and Language · Computer Science 2023-10-23 Xiaoliang Chen , Liangbin Li , Le Chang , Yunhe Huang , Yuxuan Zhao , Yuxiao Zhang , Dinuo Li

This paper investigates some of the risks introduced by "LLM poisoning," the intentional or unintentional introduction of malicious or biased data during model training. We demonstrate how a seemingly improved LLM, fine-tuned on a limited…

Cryptography and Security · Computer Science 2025-11-05 Patrick Karlsen , Even Eilertsen

Chemical Language Models (CLMs) pre-trained on large scale molecular data are widely used for molecular property prediction. However, the common belief that increasing training resources such as model size, dataset size, and training…

Machine Learning · Computer Science 2026-05-14 Tatsuya Sagawa , Ryosuke Kojima

As open-weight large language models (LLMs) achieve ever more impressive performances across a wide range of tasks in English, practitioners aim to adapt these models to different languages. However, such language adaptation is often…

Machine Learning · Computer Science 2024-07-17 Anton Alexandrov , Veselin Raychev , Mark Niklas Müller , Ce Zhang , Martin Vechev , Kristina Toutanova

As large language models (LLMs) are applied across diverse domains, the ability to selectively unlearn specific information is becoming increasingly essential. For instance, LLMs are expected to selectively provide confidential information…

Computation and Language · Computer Science 2025-06-04 Shota Takashiro , Takeshi Kojima , Andrew Gambardella , Qi Cao , Yusuke Iwasawa , Yutaka Matsuo

Transformer-based Large Language Models (LLMs) have revolutionized Natural Language Processing by demonstrating exceptional performance across diverse tasks. This study investigates the impact of the parameter initialization scale on the…

Computation and Language · Computer Science 2025-05-22 Junjie Yao , Zhongwang Zhang , Zhi-Qin John Xu

Large Language Models (LLMs) have a privacy concern because they memorize training data (including personally identifiable information (PII) like emails and phone numbers) and leak it during inference. A company can train an LLM on its…

Cryptography and Security · Computer Science 2023-07-21 Jaydeep Borkar

Large language models (LLMs) have demonstrated revolutionary capabilities in understanding complex contexts and performing a wide range of tasks. However, LLMs can also answer questions that are unethical or harmful, raising concerns about…

Cryptography and Security · Computer Science 2025-04-15 Kang Yang , Guanhong Tao , Xun Chen , Jun Xu

Continual Learning research typically focuses on tackling the phenomenon of catastrophic forgetting in neural networks. Catastrophic forgetting is associated with an abrupt loss of knowledge previously learned by a model when the task, or…

Machine Learning · Computer Science 2022-04-06 MohammadReza Davari , Nader Asadi , Sudhir Mudur , Rahaf Aljundi , Eugene Belilovsky

Broad, open source availability of large pretrained foundation models on the internet through platforms such as HuggingFace has taken the world of practical deep learning by storm. A classical pipeline for neural network training now…

Machine Learning · Computer Science 2025-05-21 Albin Soutif--Cormerais , Simone Magistri , Joost van de Weijer , Andew D. Bagdanov

Catastrophic forgetting is a problem faced by many machine learning models and algorithms. When trained on one task, then trained on a second task, many machine learning models "forget" how to perform the first task. This is widely believed…

Machine Learning · Statistics 2015-03-05 Ian J. Goodfellow , Mehdi Mirza , Da Xiao , Aaron Courville , Yoshua Bengio

Continual learning on sequential data is critical for many machine learning (ML) deployments. Unfortunately, LSTM networks, which are commonly used to learn on sequential data, suffer from catastrophic forgetting and are limited in their…

Machine Learning · Computer Science 2023-05-30 Ketaki Joshi , Raghavendra Pradyumna Pothukuchi , Andre Wibisono , Abhishek Bhattacharjee

As large language models (LLMs) gain popularity, their vulnerability to adversarial attacks emerges as a primary concern. While fine-tuning models on domain-specific datasets is often employed to improve model performance, it can…

Computation and Language · Computer Science 2026-02-24 Punya Syon Pandey , Samuel Simko , Kellin Pelrine , Zhijing Jin

Unlearning methods have the potential to improve the privacy and safety of large language models (LLMs) by removing sensitive or harmful information post hoc. The LLM unlearning research community has increasingly turned toward empirical…

Computation and Language · Computer Science 2025-04-09 Pratiksha Thaker , Shengyuan Hu , Neil Kale , Yash Maurya , Zhiwei Steven Wu , Virginia Smith

Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse natural language processing tasks, but their tendency to memorize training data poses significant privacy risks, particularly during fine-tuning…

Computation and Language · Computer Science 2025-08-21 Badrinath Ramakrishnan , Akshaya Balaji
‹ Prev 1 4 5 6 7 8 10 Next ›