中文
相关论文

相关论文: Robust Linear Regression: Gradient-descent, Early-…

200 篇论文

Gaussian processes (GPs) enable principled computation of model uncertainty, making them attractive for safety-critical applications. Such scenarios demand that GP decisions are not only accurate, but also robust to perturbations. In this…

机器学习 · 计算机科学 2021-04-08 Andrea Patane , Arno Blaas , Luca Laurenti , Luca Cardelli , Stephen Roberts , Marta Kwiatkowska

State-of-the-art deep neural networks are sensitive to small input perturbations. Since the discovery of this intriguing vulnerability, many defence methods have been proposed that attempt to improve robustness to adversarial noise. Fast…

机器学习 · 计算机科学 2021-06-04 Alexander Matyasko , Lap-Pui Chau

Graph neural networks (GNNs) which apply the deep neural networks to graph data have achieved significant performance for the task of semi-supervised node classification. However, only few work has addressed the adversarial robustness of…

机器学习 · 计算机科学 2019-10-16 Kaidi Xu , Hongge Chen , Sijia Liu , Pin-Yu Chen , Tsui-Wei Weng , Mingyi Hong , Xue Lin

It has been shown that deep neural networks (DNNs) may be vulnerable to adversarial attacks, raising the concern on their robustness particularly for safety-critical applications. Recognizing the local nature and limitations of existing…

机器学习 · 计算机科学 2019-06-20 Hanbin Hu , Mit Shah , Jianhua Z. Huang , Peng Li

In this paper, we investigate the impact of test-time adversarial attacks on linear regression models and determine the optimal level of robustness that any model can reach while maintaining a given level of standard predictive performance…

机器学习 · 统计学 2023-08-02 Elvis Dohmatob , Meyer Scetbon

Unsupervised learning of generative models has seen tremendous progress over recent years, in particular due to generative adversarial networks (GANs), variational autoencoders, and flow-based models. GANs have dramatically improved sample…

计算机视觉与模式识别 · 计算机科学 2020-01-06 Thomas Lucas , Konstantin Shmelkov , Karteek Alahari , Cordelia Schmid , Jakob Verbeek

Adversarial Training (AT) with Projected Gradient Descent (PGD) is an effective approach for improving the robustness of the deep neural networks. However, PGD AT has been shown to suffer from two main limitations: i) high computational…

计算机视觉与模式识别 · 计算机科学 2020-12-29 Ahmadreza Jeddi , Mohammad Javad Shafiee , Alexander Wong

The introduction of robust optimisation has pushed the state-of-the-art in defending against adversarial attacks. Notably, the state-of-the-art projected gradient descent (PGD)-based training method has been shown to be universally and…

计算机视觉与模式识别 · 计算机科学 2023-01-12 Ezekiel Soremekun , Sakshi Udeshi , Sudipta Chattopadhyay

The effectiveness of supervised learning techniques has made them ubiquitous in research and practice. In high-dimensional settings, supervised learning commonly relies on dimensionality reduction to improve performance and identify the…

机器学习 · 计算机科学 2016-08-11 Chang Liu , Bo Li , Yevgeniy Vorobeychik , Alina Oprea

Deep reinforcement learning (DRL) has emerged as a promising paradigm for autonomous driving. However, despite their advanced capabilities, DRL-based policies remain highly vulnerable to adversarial attacks, posing serious safety risks in…

机器学习 · 计算机科学 2025-06-24 Junchao Fan , Xuyang Lei , Xiaolin Chang

The Gaussian process (GP) regression can be severely biased when the data are contaminated by outliers. This paper presents a new robust GP regression algorithm that iteratively trims the most extreme data points. While the new algorithm…

机器学习 · 计算机科学 2021-06-15 Zhao-Zhou Li , Lu Li , Zhengyi Shao

The behavior of the gradient descent (GD) algorithm is analyzed for a deep neural network model with skip-connections. It is proved that in the over-parametrized regime, for a suitable initialization, with high probability GD can find a…

机器学习 · 计算机科学 2019-04-16 Weinan E , Chao Ma , Qingcan Wang , Lei Wu

Projected Gradient Descent (PGD) based adversarial training has become one of the most prominent methods for building robust deep neural network models. However, the computational complexity associated with this approach, due to the…

机器学习 · 计算机科学 2020-05-01 Sidharth Gupta , Parijat Dube , Ashish Verma

Recent advances show that deep neural networks are not robust to deliberately crafted adversarial examples which many are generated by adding human imperceptible perturbation to clear input. Consider $l_2$ norms attacks, Project Gradient…

机器学习 · 计算机科学 2019-06-11 Fanyou Wu , Rado Gazo , Eva Haviarova , Bedrich Benes

Adversarial training is a principled approach for training robust neural networks. Despite of tremendous successes in practice, its theoretical properties still remain largely unexplored. In this paper, we provide new theoretical insights…

机器学习 · 计算机科学 2019-07-29 Yan Li , Ethan X. Fang , Huan Xu , Tuo Zhao

Most adversarial attack defense methods rely on obfuscating gradients. These methods are successful in defending against gradient-based attacks; however, they are easily circumvented by attacks which either do not use the gradient or by…

机器学习 · 计算机科学 2022-01-14 Mitra Alirezaei , Tolga Tasdizen

We address the problem of Gaussian Process (GP) optimization in the presence of unknown and potentially varying adversarial perturbations. Unlike traditional robust optimization approaches that focus on maximizing performance under…

机器学习 · 计算机科学 2025-12-12 Artun Saday , Yaşar Cahit Yıldırım , Cem Tekin

As designers of artificial intelligence try to outwit hackers, both sides continue to hone in on AI's inherent vulnerabilities. Designed and trained from certain statistical distributions of data, AI's deep neural networks (DNNs) remain…

计算机视觉与模式识别 · 计算机科学 2022-04-25 Wenzhao Xiang , Hang Su , Chang Liu , Yandong Guo , Shibao Zheng

Improving the resistance of deep neural networks against adversarial attacks is important for deploying models to realistic applications. However, most defense methods are designed to defend against intensity perturbations and ignore…

机器学习 · 计算机科学 2020-10-07 Pengfei Xia , Bin Li

Deep Neural Networks (DNNs) have recently achieved great success in many tasks, which encourages DNNs to be widely used as a machine learning service in model sharing scenarios. However, attackers can easily generate adversarial examples…

机器学习 · 计算机科学 2019-07-17 Xiaowei Zhou , Ivor W. Tsang , Jie Yin