English
Related papers

Related papers: Unleashing Uncertainty: Efficient Machine Unlearni…

200 papers

Discrete diffusion models generate sequences by iteratively denoising samples corrupted by categorical noise, offering an appealing alternative to autoregressive decoding for structured and symbolic generation. However, standard training…

Machine Learning · Computer Science 2026-02-04 Huu Binh Ta , Michael Cardei , Alvaro Velasquez , Ferdinando Fioretto

Large language models (LLMs) require iterative updates to address the outdated information problem, where LLM unlearning offers an approach for selective removal. However, mainstream unlearning methods primarily rely on fine-tuning…

Computation and Language · Computer Science 2025-09-29 Miao Yu , Liang Lin , Guibin Zhang , Xinfeng Li , Junfeng Fang , Xingrui Yu , Ivor Tsang , Ningyu Zhang , Kun Wang , Yang Wang

Recent advancements in diffusion models have enabled high-fidelity and photorealistic image generation across diverse applications. However, these models also present security and privacy risks, including copyright violations, sensitive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Jiacheng Shi , Yanfu Zhang , Huajie Shao , Ashley Gao

Selective classification is a powerful tool for automated decision-making in high-risk scenarios, allowing classifiers to act only when confident and abstain when uncertainty is high. Given a target accuracy, our goal is to minimize…

Statistics Theory · Mathematics 2025-10-28 Mohamed Ndaoud , Peter Radchenko , Bradley Rava

Neural network classifiers trained with cross-entropy loss achieve strong predictive accuracy but lack the capability to provide inherent predictive uncertainty estimates, thus requiring external techniques to obtain these estimates. In…

Machine Learning · Statistics 2026-04-08 Courtney Franzen , Farhad Pourkamali-Anaraki

To comply with AI and data regulations, the need to forget private or copyrighted information from trained machine learning models is increasingly important. The key challenge in unlearning is forgetting the necessary data in a timely…

Machine Learning · Computer Science 2024-12-03 Jack Foster , Kyle Fogarty , Stefan Schoepf , Zack Dugue , Cengiz Öztireli , Alexandra Brintrup

Text-to-image diffusion models have achieved remarkable progress, yet their use raises copyright and misuse concerns, prompting research into machine unlearning. However, extending multi-concept unlearning to large-scale scenarios remains…

Machine Learning · Computer Science 2026-05-19 Kaiyuan Deng , Gen Li , Yang Xiao , Bo Hui , Xiaolong Ma

Uncertainty calibration is crucial for various machine learning applications, yet it remains challenging. Many models exhibit hallucinations - confident yet inaccurate responses - due to miscalibrated confidence. Here, we show that the…

Machine Learning · Computer Science 2025-03-28 Jeonghwan Cheon , Se-Bum Paik

Deep neural networks (DNNs) have achieved remarkable success across diverse domains, but their performance can be severely degraded by noisy or corrupted training data. Conventional noise mitigation methods often rely on explicit…

Machine Learning · Computer Science 2025-06-16 Deliang Jin , Gang Chen , Shuo Feng , Yufeng Ling , Haoran Zhu

Generative AI technologies have been deployed in many places, such as (multimodal) large language models and vision generative models. Their remarkable performance should be attributed to massive training data and emergent reasoning…

Machine Learning · Computer Science 2024-07-31 Zheyuan Liu , Guangyao Dou , Zhaoxuan Tan , Yijun Tian , Meng Jiang

The current trend in data regulation requirements and privacy-preserving machine learning has emphasized the importance of machine unlearning. The naive approach to unlearning training data by retraining over the complement of the forget…

Machine Learning · Computer Science 2024-05-14 Junaid Iqbal Khan

Machine learning in the context of noise is a challenging but practical setting to plenty of real-world applications. Most of the previous approaches in this area focus on the pairwise relation (casual or correlational relationship) with…

Machine Learning · Computer Science 2021-03-18 Qizhou Wang , Jiangchao Yao , Chen Gong , Tongliang Liu , Mingming Gong , Hongxia Yang , Bo Han

Deep neural networks are often ignorant about what they do not know and overconfident when they make uninformed predictions. Some recent approaches quantify classification uncertainty directly by training the model to output high…

Machine Learning · Computer Science 2020-06-09 Murat Sensoy , Lance Kaplan , Federico Cerutti , Maryam Saleki

Softmax GAN is a novel variant of Generative Adversarial Network (GAN). The key idea of Softmax GAN is to replace the classification loss in the original GAN with a softmax cross-entropy loss in the sample space of one single batch. In the…

Machine Learning · Computer Science 2020-06-26 Min Lin

We propose the use of Bayesian networks, which provide both a mean value and an uncertainty estimate as output, to enhance the safety of learned control policies under circumstances in which a test-time input differs significantly from the…

Machine Learning · Computer Science 2019-02-18 Keuntaek Lee , Kamil Saigol , Evangelos A. Theodorou

Diffusion models have demonstrated powerful performance in generating high-quality images. A typical example is text-to-image generator like Stable Diffusion. However, their widespread use also poses potential privacy risks. A key concern…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Guo Li , Weihong Chen , Yongfu Fan

Diffusion models achieve state-of-the-art video generation quality, but their inference remains expensive due to the large number of sequential denoising steps. This has motivated a growing line of research on accelerating diffusion…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Yasaman Haghighi , Alexandre Alahi

Privacy has become a major concern in machine learning. In fact, the federated learning is motivated by the privacy concern as it does not allow to transmit the private data but only intermediate updates. However, federated learning does…

Machine Learning · Computer Science 2022-09-19 Qiongxiu Li , Jaron Skovsted Gundersen , Katrine Tjell , Rafal Wisniewski , Mads Græsbøll Christensen

We introduce ContinualFlow, a principled framework for targeted unlearning in generative models via Flow Matching. Our method leverages an energy-based reweighting loss to softly subtract undesired regions of the data distribution without…

Machine Learning · Computer Science 2025-06-24 Lorenzo Simone , Davide Bacciu , Shuangge Ma

With the extensive use of machine learning technologies, data providers encounter increasing privacy risks. Recent legislation, such as GDPR, obligates organizations to remove requested data and its influence from a trained model. Machine…

Computers and Society · Computer Science 2024-11-07 Hengzhu Liu , Tianqing Zhu , Lefeng Zhang , Ping Xiong