中文
相关论文

相关论文: Annealing Self-Distillation Rectification Improves…

200 篇论文

Vision-Language Models (VLMs) are increasingly deployed in safety-critical applications, making their adversarial robustness a crucial concern. While adversarial knowledge distillation has shown promise in transferring robustness from…

计算机视觉与模式识别 · 计算机科学 2025-11-24 Yuqi Li , Junhao Dong , Chuanguang Yang , Shiping Wen , Piotr Koniusz , Tingwen Huang , Yingli Tian , Yew-Soon Ong

Advanced Persistent Threats (APTs) present a considerable challenge to cybersecurity due to their stealthy, long-duration nature. Traditional supervised learning methods typically require large amounts of labeled data, which is often scarce…

密码学与安全 · 计算机科学 2025-09-08 Sidahmed Benabderrahmane , Talal Rahwan

Distribution shifts and adversarial examples are two major challenges for deploying machine learning models. While these challenges have been studied individually, their combination is an important topic that remains relatively…

机器学习 · 计算机科学 2024-02-20 Yunjuan Wang , Hussein Hazimeh , Natalia Ponomareva , Alexey Kurakin , Ibrahim Hammoud , Raman Arora

Adversarially robust optimization (ARO) has emerged as the *de facto* standard for training models that hedge against adversarial attacks in the test stage. While these models are robust against adversarial attacks, they tend to suffer…

最优化与控制 · 数学 2025-06-12 Aras Selvi , Eleonora Kreacic , Mohsen Ghassemi , Vamsi Potluru , Tucker Balch , Manuela Veloso

We introduce Adversarial Diffusion Distillation (ADD), a novel training approach that efficiently samples large-scale foundational image diffusion models in just 1-4 steps while maintaining high image quality. We use score distillation to…

计算机视觉与模式识别 · 计算机科学 2023-11-29 Axel Sauer , Dominik Lorenz , Andreas Blattmann , Robin Rombach

Deep neural networks are increasingly being used to detect and diagnose medical conditions using medical imaging. Despite their utility, these models are highly vulnerable to adversarial attacks and distribution shifts, which can affect…

图像与视频处理 · 电气工程与系统科学 2025-06-23 Josué Martínez-Martínez , Olivia Brown , Mostafa Karami , Sheida Nabavi

By injecting adversarial examples into training data, adversarial training is promising for improving the robustness of deep learning models. However, most existing adversarial training approaches are based on a specific type of adversarial…

机器学习 · 计算机科学 2019-03-18 Chuanbiao Song , Kun He , Liwei Wang , John E. Hopcroft

Sharpness-Aware Minimization (SAM) is an effective method for improving generalization ability by regularizing loss sharpness. In this paper, we explore SAM in the context of adversarial robustness. We find that using only SAM can achieve…

机器学习 · 计算机科学 2023-07-04 Zeming Wei , Jingyu Zhu , Yihao Zhang

In ordinary distillation, student networks are trained with soft labels (SLs) given by pretrained teacher networks, and students are expected to improve upon teachers since SLs are stronger supervision than the original hard labels.…

机器学习 · 计算机科学 2022-03-11 Jianing Zhu , Jiangchao Yao , Bo Han , Jingfeng Zhang , Tongliang Liu , Gang Niu , Jingren Zhou , Jianliang Xu , Hongxia Yang

Data-driven deep learning (DL) techniques developed for automatic modulation classification (AMC) of wireless signals are vulnerable to adversarial attacks. This poses a severe security threat to the DL-based wireless systems, specifically…

信号处理 · 电气工程与系统科学 2024-04-25 Nayan Moni Baishya , B. R. Manoj

Adversarial training is an effective method to boost model robustness to malicious, adversarial attacks. However, such improvement in model robustness often leads to a significant sacrifice of standard performance on clean images. In many…

机器学习 · 计算机科学 2022-04-29 Pengyue Hou , Ming Zhou , Jie Han , Petr Musilek , Xingyu Li

Minimizing prediction uncertainty on unlabeled data is a key factor to achieve good performance in semi-supervised learning (SSL). The prediction uncertainty is typically expressed as the \emph{entropy} computed by the transformed…

机器学习 · 计算机科学 2021-12-16 Jing Li , Yuangang Pan , Ivor W. Tsang

Despite the high performance achieved by deep neural networks on various tasks, extensive studies have demonstrated that small tweaks in the input could fail the model predictions. This issue of deep neural networks has led to a number of…

机器学习 · 计算机科学 2022-02-22 Ming-Chang Chiu , Xuezhe Ma

Out-of-distribution (OOD) detection has recently gained substantial attention due to the importance of identifying out-of-domain samples in reliability and safety. Although OOD detection methods have advanced by a great deal, they are still…

计算机视觉与模式识别 · 计算机科学 2022-10-03 Mohammad Azizmalayeri , Arshia Soltani Moakhar , Arman Zarei , Reihaneh Zohrabi , Mohammad Taghi Manzuri , Mohammad Hossein Rohban

Deep models often fail to generalize well in test domains when the data distribution differs from that in the training domain. Among numerous approaches to address this Out-of-Distribution (OOD) generalization problem, there has been a…

机器学习 · 计算机科学 2022-10-14 Qixun Wang , Yifei Wang , Hong Zhu , Yisen Wang

Recommendation systems often rely on implicit feedback, where only positive user-item interactions can be observed. Negative sampling is therefore crucial to provide proper negative training signals. However, existing methods tend to…

信息检索 · 计算机科学 2026-01-06 Na Li , Fanghui Sun , Yan Zou , Yangfu Zhu , Xiatian Zhu , Ying Ma

Deep Neural Networks are vulnerable to adversarial attacks. Among many defense strategies, adversarial training with untargeted attacks is one of the most effective methods. Theoretically, adversarial perturbation in untargeted attacks can…

计算机视觉与模式识别 · 计算机科学 2022-12-01 Pengyue Hou , Jie Han , Xingyu Li

The label shift problem refers to the supervised learning setting where the train and test label distributions do not match. Existing work addressing label shift usually assumes access to an \emph{unlabelled} test sample. This sample may be…

机器学习 · 计算机科学 2021-08-18 Jingzhao Zhang , Aditya Menon , Andreas Veit , Srinadh Bhojanapalli , Sanjiv Kumar , Suvrit Sra

Extensive research demonstrates that Deep Reinforcement Learning (DRL) models are susceptible to adversarially constructed inputs (i.e., adversarial examples), which can mislead the agent to take suboptimal or unsafe actions. Recent methods…

机器学习 · 计算机科学 2026-02-24 Shenghong He

Deep neural networks are often overparameterized and may not easily achieve model generalization. Adversarial training has shown effectiveness in improving generalization by regularizing the change of loss on top of adversarially chosen…

机器学习 · 计算机科学 2022-12-07 Wenxuan Zhou , Fangyu Liu , Huan Zhang , Muhao Chen