English
Related papers

Related papers: Adversarially Robust Dense-Sparse Tradeoffs via He…

200 papers

Adversarial robustness is a critical challenge in deploying deep neural networks for real-world applications. While adversarial training is a widely recognized defense strategy, most existing studies focus on balanced datasets, overlooking…

Machine Learning · Computer Science 2025-03-24 Wang YuHang , Junkang Guo , Aolei Liu , Kaihao Wang , Zaitong Wu , Zhenyu Liu , Wenfei Yin , Jian Liu

In this paper we introduce the novel framework of distributionally robust games. These are multi-player games where each player models the state of nature using a worst-case distribution, also called adversarial distribution. Thus each…

Optimization and Control · Mathematics 2017-07-25 Dario Bauso , Jian Gao , Hamidou Tembine

Recently, some research show that deep neural networks are vulnerable to the adversarial attacks, the well-trainned samples or patches could be used to trick the neural network detector or human visual perception. However, these adversarial…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Xianyi Chen , Fazhan Liu , Dong Jiang , Kai Yan

We describe an approximate dynamic programming (ADP) approach to compute approximations of the optimal strategies and of the minimal losses that can be guaranteed in discounted repeated games with vector-valued losses. Such games…

Computer Science and Game Theory · Computer Science 2020-10-27 Vijay Kamble , Patrick Loiseau , Jean Walrand

Adversarial Training is a practical approach for improving the robustness of deep neural networks against adversarial attacks. Although bringing reliable robustness, the performance towards clean examples is negatively affected after…

Machine Learning · Computer Science 2024-06-18 Shiji Zhao , Xizhe Wang , Xingxing Wei

The existence of adversarial data examples has drawn significant attention in the deep-learning community; such data are seemingly minimally perturbed relative to the original data, but lead to very different outputs from a deep-learning…

Machine Learning · Computer Science 2019-11-12 Bai Li , Changyou Chen , Wenlin Wang , Lawrence Carin

Deep Neural Networks, despite their great success in diverse domains, are provably sensitive to small perturbations on correctly classified examples and lead to erroneous predictions. Recently, it was proposed that this behavior can be…

Machine Learning · Computer Science 2020-09-29 Nan Xu , Oluwaseyi Feyisetan , Abhinav Aggarwal , Zekun Xu , Nathanael Teissier

A pseudo-deterministic algorithm is a (randomized) algorithm which, when run multiple times on the same input, with high probability outputs the same result on all executions. Classic streaming algorithms, such as those for finding heavy…

Computational Complexity · Computer Science 2019-11-27 Shafi Goldwasser , Ofer Grossman , Sidhanth Mohanty , David P. Woodruff

Adversarial robustness has been studied extensively for offline deep networks, but less is known about strict single-pass streaming neural learners. This paper studies adversarial robustness in Fuzzy ARTMAP, an Adaptive Resonance Theory…

Machine Learning · Computer Science 2026-05-11 Shane Cairns , Leonardo Enzo Brito da Silva , Sasha Petrenko , Donald C. Wunsch , Jian Liu

Decision Transformer (DT), as one of the representative Reinforcement Learning via Supervised Learning (RvS) methods, has achieved strong performance in offline learning tasks by leveraging the powerful Transformer architecture for…

Machine Learning · Computer Science 2024-11-04 Xiaohang Tang , Afonso Marques , Parameswaran Kamalaruban , Ilija Bogunovic

An important goal in deep learning is to learn versatile, high-level feature representations of input data. However, standard networks' representations seem to possess shortcomings that, as we illustrate, prevent them from fully realizing…

Machine Learning · Statistics 2019-09-30 Logan Engstrom , Andrew Ilyas , Shibani Santurkar , Dimitris Tsipras , Brandon Tran , Aleksander Madry

The Transformer, a highly expressive architecture for sequence modeling, has recently been adapted to solve sequential decision-making, most notably through the Decision Transformer (DT), which learns policies by conditioning on desired…

Machine Learning · Computer Science 2025-10-15 Xiaohang Tang , Zhuowen Cheng , Satyabrat Kumar

Recent works have shown the effectiveness of randomized smoothing as a scalable technique for building neural network-based classifiers that are provably robust to $\ell_2$-norm adversarial perturbations. In this paper, we employ…

Machine Learning · Computer Science 2020-01-13 Hadi Salman , Greg Yang , Jerry Li , Pengchuan Zhang , Huan Zhang , Ilya Razenshteyn , Sebastien Bubeck

It is broadly known that deep neural networks are susceptible to being fooled by adversarial examples with perturbations imperceptible by humans. Various defenses have been proposed to improve adversarial robustness, among which adversarial…

Machine Learning · Computer Science 2023-03-30 Wei Wei , Jiahuan Zhou , Ying Wu

Deep Neural Networks (DNN) have been shown to be vulnerable to adversarial examples. Adversarial training (AT) is a popular and effective strategy to defend against adversarial attacks. Recent works (Benz et al., 2020; Xu et al., 2021; Tian…

Machine Learning · Computer Science 2023-02-09 Boqi Li , Weiwei Liu

Dataset distillation (DD) allows datasets to be distilled to fractions of their original size while preserving the rich distributional information, so that models trained on the distilled datasets can achieve a comparable accuracy while…

Machine Learning · Computer Science 2025-04-08 Eric Xue , Yijiang Li , Haoyang Liu , Peiran Wang , Yifan Shen , Haohan Wang

Large scale, streaming datasets are ubiquitous in modern machine learning. Streaming algorithms must be scalable, amenable to incremental training and robust to the presence of non-stationarity. In this work consider the problem of learning…

Machine Learning · Statistics 2017-12-15 Ricardo Pio Monti , Christoforos Anagnostopoulos , Giovanni Montana

Over the past few years, several adversarial training methods have been proposed to improve the robustness of machine learning models against adversarial perturbations in the input. Despite remarkable progress in this regard, adversarial…

Machine Learning · Computer Science 2022-04-04 Adel Javanmard , Mohammad Mehrabi

We say a turnstile streaming algorithm is "non-adaptive" if, during updates, the memory cells written and read depend only on the index being updated and random coins tossed at the beginning of the stream (and not on the memory contents of…

Data Structures and Algorithms · Computer Science 2014-07-09 Kasper Green Larsen , Jelani Nelson , Huy L. Nguyen

The turnstile continual release model of differential privacy captures scenarios where a privacy-preserving real-time analysis is sought for a dataset evolving through additions and deletions. In typical applications of real-time data…

Data Structures and Algorithms · Computer Science 2025-05-30 Rachel Cummings , Alessandro Epasto , Jieming Mao , Tamalika Mukherjee , Tingting Ou , Peilin Zhong