English
Related papers

Related papers: iShumei-Chinchunmei at SemEval-2025 Task 4: A bala…

200 papers

Machine unlearning empowers individuals with the `right to be forgotten' by removing their private or sensitive information encoded in machine learning models. However, it remains uncertain whether MU can be effectively applied to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Jiaqi Li , Qianshan Wei , Chuanyi Zhang , Guilin Qi , Miaozeng Du , Yongrui Chen , Sheng Bi , Fan Liu

Unlearning in Large Language Models (LLMs) is essential for ensuring ethical and responsible AI use, especially in addressing privacy leak, bias, safety, and evolving regulations. Existing approaches to LLM unlearning often rely on retain…

Computation and Language · Computer Science 2024-10-16 Yaxuan Wang , Jiaheng Wei , Chris Yuhao Liu , Jinlong Pang , Quan Liu , Ankit Parag Shah , Yujia Bao , Yang Liu , Wei Wei

Fine-tuning large language models on new data improves task performance but degrades capabilities learned during pretraining, a phenomenon known as catastrophic forgetting. Existing methods mitigate this by modifying the fine-tuning…

Machine Learning · Computer Science 2026-05-20 Parjanya Prajakta Prashant , Jiongli Zhu , Aldan Creo , Babak Salimi

The security of biomedical Multimodal Large Language Models (MLLMs) has attracted increasing attention. However, training samples easily contain private information and incorrect knowledge that are difficult to detect, potentially leading…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Dunyuan Xu , Xikai Yang , Yaoqian Li , Jinpeng Li , Pheng-Ann Heng

Machine unlearning in the domain of large language models (LLMs) has attracted great attention recently, which aims to effectively eliminate undesirable behaviors from LLMs without full retraining from scratch. In this paper, we explore the…

Computation and Language · Computer Science 2025-01-07 Zibin Pan , Shuwen Zhang , Yuesheng Zheng , Chi Li , Yuheng Cheng , Junhua Zhao

Unlearning methods have the potential to improve the privacy and safety of large language models (LLMs) by removing sensitive or harmful information post hoc. The LLM unlearning research community has increasingly turned toward empirical…

Computation and Language · Computer Science 2025-04-09 Pratiksha Thaker , Shengyuan Hu , Neil Kale , Yash Maurya , Zhiwei Steven Wu , Virginia Smith

Large Language Models (LLMs) have significantly advanced Natural Language Processing (NLP), particularly in Natural Language Understanding (NLU) tasks. As we progress toward an agentic world where LLM-based agents autonomously handle…

Computation and Language · Computer Science 2025-04-03 Naimul Haque

Machine Unlearning (MU) enables Large Language Models (LLMs) to remove unsafe or outdated information. However, existing work assumes that all facts are equally forgettable and largely ignores whether the forgotten knowledge originates from…

Computation and Language · Computer Science 2026-05-15 Borisiuk Anna , Andrey Savchenko , Alexander Panchenko , Elena Tutubalina

Tool-augmented large language models (LLMs) are often trained on datasets of query-response pairs, which embed the ability to use tools or APIs directly into the parametric knowledge of LLMs. Tool-augmented LLMs need the ability to forget…

Machine Learning · Computer Science 2025-08-07 Jiali Cheng , Hadi Amiri

Machine unlearning aims to unlearn specified training data (e.g. sensitive or copyrighted material). A prominent approach is to fine-tune an existing model with an unlearning loss that retains overall utility. The space of suitable…

Machine Learning · Computer Science 2026-02-10 Pawel Batorski , Paul Swoboda

We study how to perform unlearning, i.e. forgetting undesirable misbehaviors, on large language models (LLMs). We show at least three scenarios of aligning LLMs with human preferences can benefit from unlearning: (1) removing harmful…

Computation and Language · Computer Science 2024-02-20 Yuanshun Yao , Xiaojun Xu , Yang Liu

LLM unlearning is a technique to remove the impacts of undesirable knowledge from the model without retraining from scratch, which is indispensable towards trustworthy AI. Existing unlearning methods face significant limitations:…

Machine Learning · Computer Science 2026-03-02 Yisheng Zhong , Zhengbang Yang , Zhuangdi Zhu

Training machine learning models requires the storage of large datasets, which often contain sensitive or private data. Storing data is associated with a number of potential risks which increase over time, such as database breaches and…

Machine Learning · Computer Science 2026-04-14 Aviraj Newatia , Michael Cooper , Viet Nguyen , Rahul G. Krishnan

This paper describes our system submitted to SemEval-2026 Task 11: Disentangling Content and Formal Reasoning in Large Language Models. We present an efficient modular neuro-symbolic approach, combining a symbolic prover with small…

Computation and Language · Computer Science 2026-05-07 Ivan Kartáč , Kristýna Onderková , Jan Bronec , Zdeněk Kasner , Mateusz Lango , Ondřej Dušek

As Multimodal Large Language Models (MLLMs) develop, their potential security issues have become increasingly prominent. Machine Unlearning (MU), as an effective strategy for forgetting specific knowledge in training data, has been widely…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Junkai Chen , Zhijie Deng , Kening Zheng , Yibo Yan , Shuliang Liu , PeiJun Wu , Peijie Jiang , Jia Liu , Xuming Hu

SemEval-2024 Task 8 is focused on multigenerator, multidomain, and multilingual black-box machine-generated text detection. Such a detection is important for preventing a potential misuse of large language models (LLMs), the newest of which…

Computation and Language · Computer Science 2024-06-18 Michal Spiegel , Dominik Macko

Despite the strong capabilities of Large Language Models (LLMs) to acquire knowledge from their training corpora, the memorization of sensitive information in the corpora such as copyrighted, biased, and private content has led to ethical…

Computation and Language · Computer Science 2025-05-29 James Y. Huang , Wenxuan Zhou , Fei Wang , Fred Morstatter , Sheng Zhang , Hoifung Poon , Muhao Chen

Large language models (LLMs) are trained on massive datasets that may include private or copyrighted content. Due to growing privacy and ownership concerns, data owners may request the removal of their data from trained models. Machine…

Machine Learning · Computer Science 2026-01-13 Zhihao Liu , Jian Lou , Yuke Hu , Xiaochen Li , Yitian Chen , Tailun Chen , Zhizhen Qin , Kui Ren , Zhan Qin

This paper describes the participation of QUST_NLP in the SemEval-2025 Task 7. We propose a three-stage retrieval framework specifically designed for fact-checked claim retrieval. Initially, we evaluate the performance of several retrieval…

Computation and Language · Computer Science 2025-06-30 Jiyan Liu , Youzheng Liu , Taihang Wang , Xiaoman Xu , Yimin Wang , Ye Jiang

Large Language Models (LLMs) are constrained by their inability to process lengthy inputs, resulting in the loss of critical historical information. To address this limitation, in this paper, we propose the Self-Controlled Memory (SCM)…

Computation and Language · Computer Science 2025-03-19 Bing Wang , Xinnian Liang , Jian Yang , Hui Huang , Shuangzhi Wu , Peihao Wu , Lu Lu , Zejun Ma , Zhoujun Li