English
Related papers

Related papers: DurableUn: Quantization-Induced Recovery Attacks i…

200 papers

Certified machine unlearning aims to provably remove the influence of a deletion set $U$ from a model trained on a dataset $S$, by producing an unlearned output that is statistically indistinguishable from retraining on the retain set…

Machine Learning · Computer Science 2026-03-04 Carolin Heinzler , Kasra Malihi , Amartya Sanyal

Machine unlearning, which aims to efficiently remove the influence of specific data from trained models, is crucial for upholding data privacy regulations like the ``right to be forgotten". However, existing research predominantly evaluates…

Machine Learning · Computer Science 2026-02-24 Liheng Yu , Zhe Zhao , Yuxuan Wang , Pengkun Wang , Xiaofeng Cao , Binwu Wang , Yang Wang

Machine unlearning (MU) aims to remove the influence of specific "forget" data from a trained model while preserving its knowledge of the remaining "retain" data. Existing MU methods based on label manipulation or model weight perturbations…

Machine Learning · Computer Science 2026-05-19 Yasser H. Khalil , Mehdi Setayesh , Hongliang Li

Entity-level unlearning is usually evaluated by what a model says: whether it stops naming the target, refuses a query, or shifts a Truth Ratio distribution. These output-level tests, however, do not show whether a subject's internal…

As large language models become increasingly prevalent, memory bandwidth constraints significantly limit inference throughput, motivating post-training quantization (PTQ). In this paper, we propose FireQ, a co-designed PTQ framework and an…

Machine Learning · Computer Science 2025-07-21 Daehyeon Baek , Jieun Choi , Jimyoung Son , Kyungmin Bin , Seungbeom Choi , Kihyo Moon , Minsung Jang , Hyojung Lee

Deep quantization of neural networks (below eight bits) offers significant promise in reducing their compute and storage cost. Albeit alluring, without special techniques for training and optimization, deep quantization results in…

Machine Learning · Computer Science 2019-12-03 Ahmed T. Elthakeb , Prannoy Pilligundla , Hadi Esmaeilzadeh

Machine unlearning, which selectively removes harmful knowledge from a pre-trained model without retraining from scratch, is crucial for addressing privacy, regulatory compliance, and ethical concerns in Large Language Models (LLMs).…

Machine Learning · Computer Science 2025-11-25 Feng Guo , Yuntao Wen , Shen Gao , Junshuo Zhang , Shuo Shang

Deep Neural Networks (DNNs) typically require massive amount of computation resource in inference tasks for computer vision applications. Quantization can significantly reduce DNN computation and storage by decreasing the bitwidth of…

Machine unlearning enables the removal of specific data from ML models to uphold the right to be forgotten. While approximate unlearning algorithms offer efficient alternatives to full retraining, this work reveals that they fail to…

Machine Learning · Computer Science 2025-07-29 Yaxin Xiao , Qingqing Ye , Li Hu , Huadi Zheng , Haibo Hu , Zi Liang , Haoyang Li , Yijie Jiao

The right to be forgotten, also known as the right to erasure, is the right of individuals to have their data erased from an entity storing it. The status of this long held notion was legally solidified recently by the General Data…

Cryptography and Security · Computer Science 2020-12-02 David Marco Sommer , Liwei Song , Sameer Wagh , Prateek Mittal

Machine unlearning aims to remove the influence of a designated forget set from a trained model while preserving utility on the retained data. In modern deep networks, approximate unlearning frequently fails under large or adversarial…

Machine Learning · Computer Science 2026-02-11 Mohammad Partohaghighi , Roummel Marcia , Bruce J. West , YangQuan Chen

We report on aggressive quantization strategies that greatly accelerate inference of Recurrent Neural Network Transducers (RNN-T). We use a 4 bit integer representation for both weights and activations and apply Quantization Aware Training…

The concept of the right to be forgotten has led to growing interest in machine unlearning, but reliable validation methods are lacking, creating opportunities for dishonest model providers to mislead data contributors. Traditional invasive…

Machine Learning · Computer Science 2024-08-13 Chunyi Zhou , Anmin Fu , Zhiyang Dai

Reinforcement Learning with Verifiable Rewards (RLVR) has become a core training stage in recent large language models (LLMs). Its reliance on non-public, high-value prompt sets raises concerns about unauthorized data use, creating a need…

Cryptography and Security · Computer Science 2026-05-12 Yule Liu , Heyi Zhang , Jinyi Zheng , Zhen Sun , Zifan Peng , Jiaheng Wei , Tianshuo Cong , Yilong Yang , Xinlei He

Deep reinforcement learning continues to show tremendous potential in achieving task-level autonomy, however, its computational and energy demands remain prohibitively high. In this paper, we tackle this problem by applying quantization to…

MXFP4 arithmetic can dramatically accelerate reinforcement learning (RL) post-training of large language models (LLMs), yet the quantization error introduces severe accuracy degradation. Existing work treats the quantization error as a…

Machine Learning · Computer Science 2026-05-25 Xiaocan Li , Shiliang Wu , Zheng Shen

Deep neural network (DNN)-based policy models like vision-language-action (VLA) models are transformative in automating complex decision-making across applications by interpreting multi-modal data. However, scaling these models greatly…

Robotics · Computer Science 2024-12-03 Seongmin Park , Hyungmin Kim , Wonseok Jeon , Juyoung Yang , Byeongwook Jeon , Yoonseon Oh , Jungwook Choi

Ramp metering is the act of controlling on-going vehicles to the highway mainlines. Decades of practices of ramp metering have proved that ramp metering can decrease total travel time, mitigate shockwaves, decrease rear-end collisions by…

Machine Learning · Computer Science 2023-08-15 Diyi Liu , Lanmin Liu , Lee D Han

The compression of deep learning models is of fundamental importance in deploying such models to edge devices. The selection of compression parameters can be automated to meet changes in the hardware platform and application using…

Machine Learning · Computer Science 2022-01-21 Nesma M. Rezk , Tomas Nordström , Dimitrios Stathis , Zain Ul-Abdin , Eren Erdal Aksoy , Ahmed Hemani

The key-value (KV) cache in large language models presents a significant memory bottleneck during inference, growing linearly with sequence length and often exceeding the memory footprint of model weights themselves. We implement and…

Machine Learning · Computer Science 2026-01-09 Maanas Taneja , Purab Shingvi