English
Related papers

Related papers: A3Net: Adversarial-and-Attention Network for Machi…

200 papers

SentiNet is a novel detection framework for localized universal attacks on neural networks. These attacks restrict adversarial noise to contiguous portions of an image and are reusable with different images -- constraints that prove useful…

Cryptography and Security · Computer Science 2020-05-12 Edward Chou , Florian Tramèr , Giancarlo Pellegrino

Deep Reinforcement Learning (RL) is well known for being highly sensitive to hyperparameters, requiring practitioners substantial efforts to optimize them for the problem at hand. This also limits the applicability of RL in real-world…

Machine Learning · Computer Science 2025-03-04 Théo Vincent , Fabian Wahren , Jan Peters , Boris Belousov , Carlo D'Eramo

This paper introduces Adversarial Resilience Learning (ARL), a concept to model, train, and analyze artificial neural networks as representations of competitive agents in highly complex systems. In our examples, the agents normally take the…

Artificial Intelligence · Computer Science 2018-11-16 Lars Fischer , Jan-Menno Memmen , Eric MSP Veith , Martin Tröschel

In this paper we propose a new family of algorithms, ATENT, for training adversarially robust deep neural networks. We formulate a new loss function that is equipped with an additional entropic regularization. Our loss function considers…

Machine Learning · Computer Science 2021-02-22 Gauri Jagatap , Ameya Joshi , Animesh Basak Chowdhury , Siddharth Garg , Chinmay Hegde

Federated learning distributes model training among a multitude of agents, who, guided by privacy concerns, perform training using their local data but share only model parameter updates, for iterative aggregation at the server. In this…

Machine Learning · Computer Science 2019-11-26 Arjun Nitin Bhagoji , Supriyo Chakraborty , Prateek Mittal , Seraphin Calo

We study the problem of knowledge tracing (KT) where the goal is to trace the students' knowledge mastery over time so as to make predictions on their future performance. Owing to the good representation capacity of deep neural networks…

Computers and Society · Computer Science 2021-08-11 Xiaopeng Guo , Zhijie Huang , Jie Gao , Mingyu Shang , Maojing Shu , Jun Sun

Deep learning models are intrinsically sensitive to distribution shifts in the input data. In particular, small, barely perceivable perturbations to the input data can force models to make wrong predictions with high confidence. An common…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Paul Gavrikov , Janis Keuper

Machine learning based network intrusion detection systems are vulnerable to adversarial attacks that degrade classification performance under both gradient-based and distribution shift threat models. Existing defenses typically apply…

Cryptography and Security · Computer Science 2026-03-03 Oluseyi Olukola , Nick Rahimi

Pre-trained language models have achieved human-level performance on many Machine Reading Comprehension (MRC) tasks, but it remains unclear whether these models truly understand language or answer questions by exploiting statistical biases…

Computation and Language · Computer Science 2021-05-26 Jieyu Lin , Jiajie Zou , Nai Ding

Active vision is inherently attention-driven: The agent actively selects views to attend in order to fast achieve the vision task while improving its internal representation of the scene being observed. Inspired by the recent success of…

Computer Vision and Pattern Recognition · Computer Science 2022-01-12 Min Liu , Yifei Shi , Lintao Zheng , Kai Xu , Hui Huang , Dinesh Manocha

Machine translation and other NLP systems often contain significant biases regarding sensitive attributes, such as gender or race, that worsen system performance and perpetuate harmful stereotypes. Recent preliminary research suggests that…

Computation and Language · Computer Science 2022-03-22 Eve Fleisig , Christiane Fellbaum

Adversarial neural networks solve many important problems in data science, but are notoriously difficult to train. These difficulties come from the fact that optimal weights for adversarial nets correspond to saddle points, and not…

Machine Learning · Computer Science 2018-02-12 Abhay Yadav , Sohil Shah , Zheng Xu , David Jacobs , Tom Goldstein

Adversarial training has been considered an imperative component for safely deploying neural network-based applications to the real world. To achieve stronger robustness, existing methods primarily focus on how to generate strong attacks by…

Machine Learning · Computer Science 2023-09-01 Yeachan Kim , Seongyeon Kim , Ihyeok Seo , Bonggun Shin

Adversarial training of Deep Neural Networks is known to be significantly more data-hungry when compared to standard training. Furthermore, complex data augmentations such as AutoAugment, which have led to substantial gains in standard…

Machine Learning · Computer Science 2022-10-28 Sravanti Addepalli , Samyak Jain , R. Venkatesh Babu

Deep network compression has been achieved notable progress via knowledge distillation, where a teacher-student learning manner is adopted by using predetermined loss. Recently, more focuses have been transferred to employ the adversarial…

Machine Learning · Computer Science 2019-04-26 Shu Changyong , Li Peng , Xie Yuan , Qu Yanyun , Dai Longquan , Ma Lizhuang

Machine learning systems and also, specifically, automatic speech recognition (ASR) systems are vulnerable against adversarial attacks, where an attacker maliciously changes the input. In the case of ASR systems, the most interesting cases…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-04 Sina Däubener , Lea Schönherr , Asja Fischer , Dorothea Kolossa

As one of the major sources in speech variability, accents have posed a grand challenge to the robustness of speech recognition systems. In this paper, our goal is to build a unified end-to-end speech recognition system that generalizes…

Computation and Language · Computer Science 2019-11-28 Yi-Chen Chen , Zhaojun Yang , Ching-Feng Yeh , Mahaveer Jain , Michael L. Seltzer

We study the robustness of machine learning approaches to adversarial perturbations, with a focus on supervised learning scenarios. We find that typical phase classifiers based on deep neural networks are extremely vulnerable to adversarial…

Disordered Systems and Neural Networks · Physics 2024-01-26 Si Jiang , Sirui Lu , Dong-Ling Deng

Can we leverage high-resolution information without the unsustainable quadratic complexity to input scale? We propose Traversal Network (TNet), a novel multi-scale hard-attention architecture, which traverses image scale-space in a top-down…

Computer Vision and Pattern Recognition · Computer Science 2021-11-01 Athanasios Papadopoulos , Paweł Korus , Nasir Memon

It has been demonstrated that deep neural networks are prone to noisy examples particular adversarial samples during inference process. The gap between robust deep learning systems in real world applications and vulnerable neural networks…

Machine Learning · Computer Science 2018-07-03 Xinhan Di , Pengqian Yu , Meng Tian