English
Related papers

Related papers: Adversarial Attacks to Reward Machine-based Reinfo…

200 papers

Implicit Neural Representations (INRs) have been recently garnering increasing interest in various research fields, mainly due to their ability to represent large, complex data in a compact, continuous manner. Past work further showed that…

Machine Learning · Computer Science 2026-03-04 Tamir Shor , Ethan Fetaya , Chaim Baskin , Alex Bronstein

Multi-modal Large Language Models (MLLMs) have recently achieved enhanced performance across various vision-language tasks including visual grounding capabilities. However, the adversarial robustness of visual grounding remains unexplored…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Kuofeng Gao , Yang Bai , Jiawang Bai , Yong Yang , Shu-Tao Xia

Multimodal Reward Models (MRMs) play a crucial role in enhancing the performance of Multimodal Large Language Models (MLLMs). While recent advancements have primarily focused on improving the model structure and training data of MRMs, there…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Yi-Fan Zhang , Xingyu Lu , Xiao Hu , Chaoyou Fu , Bin Wen , Tianke Zhang , Changyi Liu , Kaiyu Jiang , Kaibing Chen , Kaiyu Tang , Haojie Ding , Jiankang Chen , Fan Yang , Zhang Zhang , Tingting Gao , Liang Wang

Artificial Intelligence has achieved remarkable success across diverse application domains. However, its vulnerability to adversarial attacks poses significant challenges to reliability, security, and trustworthiness. Adversarial machine…

Cryptography and Security · Computer Science 2026-05-29 Jaydip Sen

Learning-based pattern classifiers, including deep networks, have shown impressive performance in several application domains, ranging from computer vision to cybersecurity. However, it has also been shown that adversarial input…

Computer Vision and Pattern Recognition · Computer Science 2018-07-24 Battista Biggio , Fabio Roli

Finding meaningful and accurate dense rewards is a fundamental task in the field of reinforcement learning (RL) that enables agents to explore environments more efficiently. In traditional RL settings, agents learn optimal policies through…

Artificial Intelligence · Computer Science 2025-12-05 Shuyuan Zhang

Reinforcement learning often uses neural networks to solve complex control tasks. However, neural networks are sensitive to input perturbations, which makes their deployment in safety-critical environments challenging. This work lifts…

Machine Learning · Computer Science 2024-08-20 Manuel Wendl , Lukas Koller , Tobias Ladner , Matthias Althoff

The robustness of modern machine learning (ML) models has become an increasing concern within the community. The ability to subvert a model into making errant predictions using seemingly inconsequential changes to input is startling, as is…

Machine Learning · Computer Science 2023-06-19 Edward Raff , Michel Benaroch , Andrew L. Farris

Process Reward Models (PRMs) enhance reasoning ability of LLMs by providing step-level supervision. However, their widespread adoption is limited due to expensive manual step-level annotation and poor generalization of static training data…

Machine Learning · Computer Science 2025-12-01 Gurusha Juneja , Deepak Nathani , William Yang Wang

Deep reinforcement learning (RL) policies are known to be vulnerable to adversarial perturbations to their observations, similar to adversarial examples for classifiers. However, an attacker is not usually able to directly modify another…

Machine Learning · Computer Science 2021-01-19 Adam Gleave , Michael Dennis , Cody Wild , Neel Kant , Sergey Levine , Stuart Russell

Machine learning models have made many decision support systems to be faster, more accurate, and more efficient. However, applications of machine learning in network security face a more disproportionate threat of active adversarial attacks…

Cryptography and Security · Computer Science 2023-03-22 Olakunle Ibitoye , Rana Abou-Khamis , Mohamed el Shehaby , Ashraf Matrawy , M. Omair Shafiq

In recent years deep reinforcement learning (RL) systems have attained superhuman performance in a number of challenging task domains. However, a major limitation of such applications is their demand for massive amounts of training data. A…

Attention-based sequential recommendation methods have shown promise in accurately capturing users' evolving interests from their past interactions. Recent research has also explored the integration of reinforcement learning (RL) into these…

Machine Learning · Computer Science 2024-04-19 Melissa Mozifian , Tristan Sylvain , Dave Evans , Lili Meng

As we seek to deploy machine learning models beyond virtual and controlled domains, it is critical to analyze not only the accuracy or the fact that it works most of the time, but if such a model is truly robust and reliable. This paper…

Machine Learning · Computer Science 2020-07-07 Samuel Henrique Silva , Peyman Najafirad

Robustness is critical for machine learning (ML) classifiers to ensure consistent performance in real-world applications where models may encounter corrupted or adversarial inputs. In particular, assessing the robustness of classifiers to…

Machine Learning · Computer Science 2024-09-06 Georg Siedel , Ekagra Gupta , Andrey Morozov

Although current deep learning techniques have yielded superior performance on various computer vision tasks, yet they are still vulnerable to adversarial examples. Adversarial training and its variants have been shown to be the most…

Computer Vision and Pattern Recognition · Computer Science 2022-11-02 Junhao Dong , Seyed-Mohsen Moosavi-Dezfooli , Jianhuang Lai , Xiaohua Xie

With the recent advancements in machine learning (ML), numerous ML-based approaches have been extensively applied in software analytics tasks to streamline software development and maintenance processes. Nevertheless, studies indicate that…

Software Engineering · Computer Science 2025-07-15 MD Abdul Awal , Mrigank Rochan , Chanchal K. Roy

A trustworthy reinforcement learning algorithm should be competent in solving challenging real-world problems, including {robustly} handling uncertainties, satisfying {safety} constraints to avoid catastrophic failures, and {generalizing}…

Machine Learning · Computer Science 2022-09-19 Mengdi Xu , Zuxin Liu , Peide Huang , Wenhao Ding , Zhepeng Cen , Bo Li , Ding Zhao

Adversarial training has been shown as an effective approach to improve the robustness of image classifiers against white-box attacks. However, its effectiveness against black-box attacks is more nuanced. In this work, we demonstrate that…

Machine Learning · Computer Science 2021-07-27 Ali Rahmati , Seyed-Mohsen Moosavi-Dezfooli , Huaiyu Dai

Computer network defence is a complicated task that has necessitated a high degree of human involvement. However, with recent advancements in machine learning, fully autonomous network defence is becoming increasingly plausible. This paper…

Cryptography and Security · Computer Science 2023-06-16 Myles Foley , Mia Wang , Zoe M , Chris Hicks , Vasilios Mavroudis