English
Related papers

Related papers: ZJUKLAB at SemEval-2025 Task 4: Unlearning via Mod…

200 papers

Federated Learning (FL) offers a promising paradigm for training Large Language Models (LLMs) in a decentralized manner while preserving data privacy and minimizing communication overhead. This survey examines recent advancements in…

Machine Learning · Computer Science 2025-05-12 Youyang Qu , Ming Liu , Tianqing Zhu , Longxiang Gao , Shui Yu , Wanlei Zhou

With the increasing importance of data privacy and security, federated unlearning emerges as a new research field dedicated to ensuring that once specific data is deleted, federated learning models no longer retain or disclose related…

Cryptography and Security · Computer Science 2026-04-07 Houzhe Wang , Xiaojie Zhu , Chi Chen

Large Language Models (LLMs) have demonstrated exceptional capabilities across diverse natural language processing (NLP) tasks. The release of open-source LLMs like LLaMA and Qwen has triggered the development of numerous fine-tuned models…

Computation and Language · Computer Science 2025-06-17 Zichuan Fu , Xian Wu , Yejing Wang , Wanyu Wang , Shanshan Ye , Hongzhi Yin , Yi Chang , Yefeng Zheng , Xiangyu Zhao

With the rapid growth of large language models for code generation, distinguishing between human-written and AI-generated code has become increasingly critical for academic integrity, hiring evaluations, and software security. We present…

Software Engineering · Computer Science 2026-05-01 Kargi Chauhan , Sadiba Nusrat Nur

This paper describes our winning system on SemEval 2022 Task 7: Identifying Plausible Clarifications of Implicit and Underspecified Phrases in Instructional Texts. A replaced token detection pre-trained model is utilized with minorly…

Computation and Language · Computer Science 2022-11-29 Junyuan Shang , Shuohuan Wang , Yu Sun , Yanjun Yu , Yue Zhou , Li Xiang , Guixiu Yang

Privacy concerns associated with machine learning models have driven research into machine unlearning, which aims to erase the memory of specific target training data from already trained models. This issue also arises in federated…

Machine Learning · Computer Science 2025-03-14 Yuyuan Li , Jiaming Zhang , Yixiu Liu , Chaochao Chen

Enabling large language models (LLMs) to unlearn knowledge and capabilities acquired during training has proven vital for ensuring compliance with data regulations and promoting ethical practices in generative AI. Although there are growing…

This paper presents our submitted system to SemEval 2021 Task 4: Reading Comprehension of Abstract Meaning. Our system uses a large pre-trained language model as the encoder and an additional dual multi-head co-attention layer to strengthen…

Computation and Language · Computer Science 2021-03-31 Yuxin Jiang , Ziyi Shou , Qijun Wang , Hao Wu , Fangzhen Lin

Recent advancements in LLMs unlearning have shown remarkable success in removing unwanted data-model influences while preserving the model's utility for legitimate knowledge. Despite these strides, sparse Mixture-of-Experts (MoE) LLMs--a…

Machine Learning · Computer Science 2025-07-01 Haomin Zhuang , Yihua Zhang , Kehan Guo , Jinghan Jia , Gaowen Liu , Sijia Liu , Xiangliang Zhang

To comply with AI and data regulations, the need to forget private or copyrighted information from trained machine learning models is increasingly important. The key challenge in unlearning is forgetting the necessary data in a timely…

Machine Learning · Computer Science 2024-12-03 Jack Foster , Kyle Fogarty , Stefan Schoepf , Zack Dugue , Cengiz Öztireli , Alexandra Brintrup

This paper presents the Annif system in SemEval-2025 Task 5 (LLMs4Subjects), which focussed on subject indexing using large language models (LLMs). The task required creating subject predictions for bibliographic records from the bilingual…

Computation and Language · Computer Science 2025-08-22 Osma Suominen , Juho Inkinen , Mona Lehtinen

Causal relation extraction of biomedical entities is one of the most complex tasks in biomedical text mining, which involves two kinds of information: entity relations and entity functions. One feasible approach is to take relation…

Computation and Language · Computer Science 2022-08-03 Dongling Li , Pengchao Wu , Yuehu Dong , Jinghang Gu , Longhua Qian , Guodong Zhou

Machine unlearning addresses the problem of updating a machine learning model/system trained on a dataset $S$ so that the influence of a set of deletion requests $U \subseteq S$ on the unlearned model is minimized. The gold standard…

Machine Learning · Computer Science 2025-06-09 Linda Lu , Ayush Sekhari , Karthik Sridharan

Machine unlearning (MU) aims to remove the influence of particular data points from the learnable parameters of a trained machine learning model. This is a crucial capability in light of data privacy requirements, trustworthiness, and…

Machine Learning · Computer Science 2025-07-01 Xavier F. Cadet , Anastasia Borovykh , Mohammad Malekzadeh , Sara Ahmadi-Abhari , Hamed Haddadi

Machine Unlearning has recently garnered significant attention, aiming to selectively remove knowledge associated with specific data while preserving the model's performance on the remaining data. A fundamental challenge in this process is…

Machine Learning · Computer Science 2025-07-29 Gaurav Patel , Qiang Qiu

Machine unlearning is a process to remove specific data points from a trained model while maintaining the performance on the retain data, addressing privacy or legal requirements. Despite its importance, existing unlearning evaluations tend…

Machine Learning · Computer Science 2026-01-30 Yongwoo Kim , Sungmin Cha , Donghyun Kim

Reading is a complex process which requires proper understanding of texts in order to create coherent mental representations. However, comprehension problems may arise due to hard-to-understand sections, which can prove troublesome for…

Computation and Language · Computer Science 2021-04-15 George-Eduard Zaharia , Dumitru-Clementin Cercel , Mihai Dascalu

The past a few years have witnessed the great success of large language models, demonstrating powerful capabilities in comprehending textual data and generating human-like languages. Large language models achieve success by being trained on…

Computation and Language · Computer Science 2025-03-20 Estrid He , Tabinda Sarwar , Ibrahim Khalil , Xun Yi , Ke Wang

With the increasing prevalence of text generated by large language models (LLMs), there is a growing concern about distinguishing between LLM-generated and human-written texts in order to prevent the misuse of LLMs, such as the…

Computation and Language · Computer Science 2024-04-02 Xiaoyan Qu , Xiangfeng Meng

Modern privacy regulations have spurred the evolution of machine unlearning, a technique that enables the removal of data from an already trained ML model without requiring retraining from scratch. Previous unlearning methods tend to induce…

Machine Learning · Computer Science 2025-05-05 Haoxuan Ji , Zheng Lin , Yuyao Sun , Gao Fei , Yuhang Wang , Haichang Gao , Zhenxing Niu