English
Related papers

Related papers: Beyond Single-Value Metrics: Evaluating and Enhanc…

200 papers

Student simulation can support learning-by-teaching pedagogy where human students (as tutors) teach AI-simulated novice students (as tutees). Recent research often relies on prompt engineering with large language models (LLMs) to simulate…

Human-Computer Interaction · Computer Science 2026-03-31 Jiajia Song , Zhihan Guo , Jionghao Lin

Machine unlearning is a process to remove specific data points from a trained model while maintaining the performance on the retain data, addressing privacy or legal requirements. Despite its importance, existing unlearning evaluations tend…

Machine Learning · Computer Science 2026-01-30 Yongwoo Kim , Sungmin Cha , Donghyun Kim

Machine Unlearning (MU) is critical for removing private or hazardous information from deep learning models. While MU has advanced significantly in unimodal (text or vision) settings, multimodal unlearning (MMU) remains underexplored due to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Alexey Dontsov , Dmitrii Korzh , Alexey Zhavoronkin , Boris Mikheev , Denis Bobkov , Aibek Alanov , Oleg Y. Rogov , Ivan Oseledets , Elena Tutubalina

With the rapid progress of diffusion-based content generation, significant efforts are being made to unlearn harmful or copyrighted concepts from pretrained diffusion models (DMs) to prevent potential model misuse. However, it is observed…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Hongcheng Gao , Tianyu Pang , Chao Du , Taihang Hu , Zhijie Deng , Min Lin

Large Language Models (LLMs) are versatile and demonstrate impressive generalization ability by mining and learning information from extensive unlabeled text. However, they still exhibit reasoning mistakes, often stemming from knowledge…

Computation and Language · Computer Science 2024-08-22 Kai Xiong , Xiao Ding , Li Du , Jiahao Ying , Ting Liu , Bing Qin , Yixin Cao

Conformal unlearning aims to ensure that a trained conformal predictor miscovers data points with specific shared characteristics, such as those from a particular label class, associated with a specific user, or belonging to a defined…

Machine Learning · Computer Science 2026-02-13 Yahya Alkhatib , Muhammad Ahmar Jamal , Wee Peng Tay

Machine unlearning for LLMs aims to remove sensitive or copyrighted data from trained models. However, the true efficacy of current unlearning methods remains uncertain. Standard evaluation metrics rely on benign queries that often mistake…

Machine Learning · Computer Science 2026-02-09 Patryk Rybak , Paweł Batorski , Paul Swoboda , Przemysław Spurek

Large Language Models (LLMs) have shown strong potential in accelerating digital hardware design through automated code generation. Yet, ensuring their reliability remains a critical challenge, as existing LLMs trained on massive…

Machine Learning · Computer Science 2025-12-08 Yiwen Liang , Qiufeng Li , Shikai Wang , Weidong Cao

Machine unlearning offers effective solutions for revoking the influence of specific training data on pre-trained model parameters. While existing approaches address unlearning for classification and generative models, they overlook an…

Machine Learning · Computer Science 2025-08-19 Yihan Wang , Yiwei Lu , Guojun Zhang , Franziska Boenisch , Adam Dziedzic , Yaoliang Yu , Xiao-Shan Gao

Large language models (LLMs) have enhanced our ability to rapidly analyze and classify unstructured natural language data. However, concerns regarding cost, network limitations, and security constraints have posed challenges for their…

Machine Learning · Computer Science 2024-11-05 David Farr , Nico Manzonelli , Iain Cruickshank , Jevin West

Large language Model (LLM) unlearning, i.e., selectively removing information from LLMs, is vital for responsible model deployment. Differently, LLM knowledge editing aims to modify LLM knowledge instead of removing it. Though editing and…

Machine Learning · Computer Science 2025-05-27 Zexi Li , Xiangzhu Wang , William F. Shen , Meghdad Kurmanji , Xinchi Qiu , Dongqi Cai , Chao Wu , Nicholas D. Lane

Cognitive diagnosis has been developed for decades as an effective measurement tool to evaluate human cognitive status such as ability level and knowledge mastery. It has been applied to a wide range of fields including education, sport,…

Artificial Intelligence · Computer Science 2024-07-09 Fei Wang , Weibo Gao , Qi Liu , Jiatong Li , Guanhao Zhao , Zheng Zhang , Zhenya Huang , Mengxiao Zhu , Shijin Wang , Wei Tong , Enhong Chen

Large Language Models (LLMs) have demonstrated strong reasoning and memorization capabilities via pretraining on massive textual corpora. However, this poses risk of privacy and copyright violations, highlighting the need for efficient…

Machine Learning · Computer Science 2025-04-28 Sungmin Cha , Sungjun Cho , Dasol Hwang , Moontae Lee

Cognitive diagnosis is a fundamental issue in intelligent education, which aims to discover the proficiency level of students on specific knowledge concepts. Existing approaches usually mine linear interactions of student exercising process…

Machine Learning · Computer Science 2020-03-04 Fei Wang , Qi Liu , Enhong Chen , Zhenya Huang , Yuying Chen , Yu Yin , Zai Huang , Shijin Wang

Machine unlearning (MU) for large language models (LLMs), commonly referred to as LLM unlearning, seeks to remove specific undesirable data or knowledge from a trained model, while maintaining its performance on standard tasks. While…

Machine Learning · Computer Science 2026-03-03 Yiwei Chen , Soumyadeep Pal , Yimeng Zhang , Qing Qu , Sijia Liu

State-of-the-art generative models exhibit powerful image-generation capabilities, introducing various ethical and legal challenges to service providers hosting these models. Consequently, Content Removal Techniques (CRTs) have emerged as a…

Machine Learning · Computer Science 2025-04-03 Piyush Nagasubramaniam , Neeraj Karamchandani , Chen Wu , Sencun Zhu

Large Language Models (LLMs) and causal learning each hold strong potential for clinical decision making (CDM). However, their synergy remains poorly understood, largely due to the lack of systematic benchmarks evaluating their integration…

Machine Learning · Computer Science 2025-11-14 Linna Wang , Zhixuan You , Qihui Zhang , Jiunan Wen , Ji Shi , Yimin Chen , Yusen Wang , Fanqi Ding , Ziliang Feng , Li Lu

In this work, we introduce Erasure of Language Memory (ELM), a principled approach to concept-level unlearning that operates by matching distributions defined by the model's own introspective classification capabilities. Our key insight is…

Computation and Language · Computer Science 2025-07-23 Rohit Gandikota , Sheridan Feucht , Samuel Marks , David Bau

Improving the accessibility of psychotherapy with the aid of Large Language Models (LLMs) is garnering a significant attention in recent years. Recognizing cognitive distortions from the interviewee's utterances can be an essential part of…

Computation and Language · Computer Science 2024-03-22 Sehee Lim , Yejin Kim , Chi-Hyun Choi , Jy-yong Sohn , Byung-Hoon Kim

As text-to-image diffusion models gain widespread commercial applications, there are increasing concerns about unethical or harmful use, including the unauthorized generation of copyrighted or sensitive content. Concept unlearning has…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Saemi Moon , Minjong Lee , Sangdon Park , Dongwoo Kim