English
Related papers

Related papers: Is Adversarial Training with Compressed Datasets E…

200 papers

Dataset distillation (DD) compresses a large training set into a small synthetic set for efficient training, but most DD methods optimize only clean accuracy and leave robustness uncontrolled. Recent robust DD methods improve robustness,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Muquan Li , Yingyi Ma , Yihong Huang , Hang Gou , Ke Qin , Ming Li , Yuan-Fang Li , Tao He

Deep learning based automatic modulation classification (AMC) has received significant attention owing to its potential applications in both military and civilian use cases. Recently, data-driven subsampling techniques have been utilized to…

Machine Learning · Computer Science 2024-01-09 Abu Shafin Mohammad Mahdee Jameel , Ahmed P. Mohamed , Jinho Yi , Aly El Gamal , Akshay Malhotra

Continual learning needs to overcome catastrophic forgetting of the past. Memory replay of representative old training samples has been shown as an effective solution, and achieves the state-of-the-art (SOTA) performance. However, existing…

Machine Learning · Computer Science 2022-03-10 Liyuan Wang , Xingxing Zhang , Kuo Yang , Longhui Yu , Chongxuan Li , Lanqing Hong , Shifeng Zhang , Zhenguo Li , Yi Zhong , Jun Zhu

Current machine learning models achieve super-human performance in many real-world applications. Still, they are susceptible against imperceptible adversarial perturbations. The most effective solution for this problem is adversarial…

Machine Learning · Computer Science 2023-01-26 Mohammad Azizmalayeri , Arman Zarei , Alireza Isavand , Mohammad Taghi Manzuri , Mohammad Hossein Rohban

Neural networks are vulnerable to small adversarial perturbations. Existing literature largely focused on understanding and mitigating the vulnerability of learned models. In this paper, we demonstrate an intriguing phenomenon about the…

Machine Learning · Computer Science 2019-02-25 Gavin Weiguang Ding , Kry Yik Chau Lui , Xiaomeng Jin , Luyu Wang , Ruitong Huang

Dataset condensation always faces a constitutive trade-off: balancing performance and fidelity under extreme compression. Existing methods struggle with two bottlenecks: image-level selection methods (Coreset Selection, Dataset…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Huyu Wu , Duo Su , Junjie Hou , Guang Li

Recent advances in adversarial robustness rely on an abundant set of training data, where using external or additional datasets has become a common setting. However, in real life, the training data is often kept private for security and…

Machine Learning · Computer Science 2024-06-25 Hyeyoon Lee , Kanghyun Choi , Dain Kwon , Sunjong Park , Mayoore Selvarasa Jaiswal , Noseong Park , Jonghyun Choi , Jinho Lee

Deep Neural Networks (DNNs) suffer from a rapid decrease in performance when trained on a sequence of tasks where only data of the most recent task is available. This phenomenon, known as catastrophic forgetting, prevents DNNs from…

Machine Learning · Computer Science 2021-04-22 Felix Wiewel , Bin Yang

Current neural-network-based classifiers are susceptible to adversarial examples. The most empirically successful approach to defending against such adversarial examples is adversarial training, which incorporates a strong self-attack…

Machine Learning · Computer Science 2020-06-08 Bai Li , Shiqi Wang , Suman Jana , Lawrence Carin

Compressed deep learning models are crucial for deploying computer vision systems on resource-constrained devices. However, model compression may affect robustness, especially under natural corruption. Therefore, it is important to consider…

Dataset bias is a problem in adversarial machine learning, especially in the evaluation of defenses. An adversarial attack or defense algorithm may show better results on the reported dataset than can be replicated on other datasets. Even…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Camilo Pestana , Wei Liu , David Glance , Ajmal Mian

Adversarial training has been widely studied in recent years due to its role in improving model robustness against adversarial attacks. This paper focuses on comparing different distributed adversarial training algorithms--including…

Machine Learning · Computer Science 2025-09-16 Ying Cao , Kun Yuan , Ali H. Sayed

Adversarial attacks induce misclassification by introducing subtle perturbations. Recently, diffusion models are applied to the image classifiers to improve adversarial robustness through adversarial training or by purifying adversarial…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Yujie Li , Yanbin Wang , Haitao Xu , Bin Liu , Jianguo Sun , Zhenhao Guo , Wenrui Ma

Dataset condensation aims to condense a large dataset with a lot of training samples into a small set. Previous methods usually condense the dataset into the pixels format. However, it suffers from slow optimization speed and large number…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 David Junhao Zhang , Heng Wang , Chuhui Xue , Rui Yan , Wenqing Zhang , Song Bai , Mike Zheng Shou

Training and deploying deepfake detection models on edge devices offers the advantage of maintaining data privacy and confidentiality by processing it close to its source. However, this approach is constrained by the limited computational…

Machine Learning · Computer Science 2025-05-01 Andreas Karathanasis , John Violos , Ioannis Kompatsiaris , Symeon Papadopoulos

Due to numerous breakthroughs in real-world applications brought by machine intelligence, deep neural networks (DNNs) are widely employed in critical applications. However, predictions of DNNs are easily manipulated with imperceptible…

Machine Learning · Computer Science 2022-05-04 Hongjun Wang , Yisen Wang

Dataset Condensation (DC) has emerged as a promising solution to mitigate the computational and storage burdens associated with training deep learning models. However, existing DC methods largely overlook the multi-domain nature of modern…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Jaehyun Choi , Gyojin Han , Dong-Jae Lee , Sunghyun Baek , Junmo Kim

Dataset distillation (DD) enhances training efficiency and reduces bandwidth by condensing large datasets into smaller synthetic ones. It enables models to achieve performance comparable to those trained on the raw full dataset and has…

Cryptography and Security · Computer Science 2025-02-07 Ziyuan Yang , Ming Yan , Yi Zhang , Joey Tianyi Zhou

Dataset Distillation (DD) is an emerging technique that compresses large-scale datasets into significantly smaller synthesized datasets while preserving high test performance and enabling the efficient training of large models. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Zheng Zhou , Wenquan Feng , Shuchang Lyu , Guangliang Cheng , Xiaowei Huang , Qi Zhao

Training recommendation models on large datasets requires significant time and resources. It is desired to construct concise yet informative datasets for efficient training. Recent advances in dataset condensation show promise in addressing…

Information Retrieval · Computer Science 2025-04-10 Jiahao Wu , Wenqi Fan , Jingfan Chen , Shengcai Liu , Qijiong Liu , Rui He , Qing Li , Ke Tang