English
Related papers

Related papers: Generation of Games for Opponent Model Differentia…

200 papers

In this paper, we study the use of deception for strategic planning in adversarial environments. We model the interaction between the agent (player 1) and the adversary (player 2) as a two-player concurrent game in which the adversary has…

Computer Science and Game Theory · Computer Science 2020-08-03 Lening Li , Haoxiang Ma , Abhishek N. Kulkarni , Jie Fu

Recent research on vulnerabilities of deep reinforcement learning (RL) has shown that adversarial policies adopted by an adversary agent can influence a target RL agent (victim agent) to perform poorly in a multi-agent environment. In…

Machine Learning · Computer Science 2022-11-01 The Viet Bui , Tien Mai , Thanh H. Nguyen

Neural networks have a number of shortcomings. Amongst the severest ones is the sensitivity to distribution shifts which allows models to be easily fooled into wrong predictions by small perturbations to inputs that are often imperceivable…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Paul Gavrikov , Janis Keuper , Margret Keuper

Machine learning has proven to be a useful tool for automated malware detection, but machine learning models have also been shown to be vulnerable to adversarial attacks. This article addresses the problem of generating adversarial malware…

Cryptography and Security · Computer Science 2024-04-09 Pavla Louthánová , Matouš Kozák , Martin Jureček , Mark Stamp

Rapid progress in deep reinforcement learning has made it increasingly feasible to train controllers for high-dimensional humanoid bodies. However, methods that use pure reinforcement learning with simple reward functions tend to produce…

Robotics · Computer Science 2017-07-11 Josh Merel , Yuval Tassa , Dhruva TB , Sriram Srinivasan , Jay Lemmon , Ziyu Wang , Greg Wayne , Nicolas Heess

Coordination and cooperation between humans and autonomous agents in cooperative games raises interesting questions of human decision making and behaviour changes. Here we report our findings from a group formation game in a small-world…

Physics and Society · Physics 2021-05-21 Tuomas Takko , Kunal Bhattacharya , Daniel Monsivais , Kimmo Kaski

Our objective in this paper is to develop a machinery that makes a given organizational strategic plan resilient to the actions of competitor agents (adverse environmental actions). We assume that we are given a goal tree representing…

Artificial Intelligence · Computer Science 2025-02-18 Aditya Ghose , Asjad Khan

When used in automated decision-making systems, machine learning (ML) models are vulnerable to data-manipulation attacks. Some defense mechanisms (e.g., adversarial regularization) directly affect the ML models while others (e.g., anomaly…

Machine Learning · Computer Science 2026-03-09 Soyon Choi , Scott Alfeld , Meiyi Ma

Currently the Dempster-Shafer based algorithm and Uniform Random Probability based algorithm are the preferred method of resolving security games, in which defenders are able to identify attackers and only strategy remained ambiguous.…

Artificial Intelligence · Computer Science 2015-08-11 Hossein Khani , Mohsen Afsharchi

While we would like agents that can coordinate with humans, current algorithms such as self-play and population-based training create agents that can coordinate with themselves. Agents that assume their partner to be optimal or similar to…

Machine Learning · Computer Science 2020-01-10 Micah Carroll , Rohin Shah , Mark K. Ho , Thomas L. Griffiths , Sanjit A. Seshia , Pieter Abbeel , Anca Dragan

Machine learning is being integrated into a growing number of critical systems with far-reaching impacts on society. Unexpected behaviour and unfair decision processes are coming under increasing scrutiny due to this widespread use and its…

Machine Learning · Computer Science 2020-09-02 Pieter Delobelle , Paul Temple , Gilles Perrouin , Benoît Frénay , Patrick Heymans , Bettina Berendt

To protect the systems exposed to the Internet against attacks, a security system with the capability to engage with the attacker is needed. There have been attempts to model the engagement/interactions between users, both benign and…

Cryptography and Security · Computer Science 2018-01-19 Vivek Shandilya , Sajjan Shiva

Recent approaches in machine learning often solve a task using a composition of multiple models or agentic architectures. When targeting a composed system with adversarial attacks, it might not be computationally or informationally feasible…

Machine Learning · Computer Science 2024-11-01 Julian Collado , Kevin Stangl

How does information regarding an adversary's intentions affect optimal system design? This paper addresses this question in the context of graphical coordination games where an adversary can indirectly influence the behavior of agents by…

Computer Science and Game Theory · Computer Science 2020-03-18 Brandon C. Collins , Philip N. Brown

Users like sharing personal photos with others through social media. At the same time, they might want to make automatic identification in such photos difficult or even impossible. Classic obfuscation methods such as blurring are not only…

Computer Vision and Pattern Recognition · Computer Science 2017-07-27 Seong Joon Oh , Mario Fritz , Bernt Schiele

Natural Language Processing (NLP) models based on Machine Learning (ML) are susceptible to adversarial attacks -- malicious algorithms that imperceptibly modify input text to force models into making incorrect predictions. However,…

Computation and Language · Computer Science 2023-05-26 Salijona Dyrmishi , Salah Ghamizi , Maxime Cordy

Machine learning algorithms are vulnerable to poisoning attacks: An adversary can inject malicious points in the training dataset to influence the learning process and degrade the algorithm's performance. Optimal poisoning attacks have…

Machine Learning · Computer Science 2019-09-26 Luis Muñoz-González , Bjarne Pfitzner , Matteo Russo , Javier Carnerero-Cano , Emil C. Lupu

Understanding the evolution of human social systems requires flexible formalisms for the emergence of institutions. Although game theory is normally used to model interactions individually, larger spaces of games can be helpful for modeling…

Physics and Society · Physics 2021-08-12 Seth Frey , Curtis Atkisson

In adversarial data collection (ADC), a human workforce interacts with a model in real time, attempting to produce examples that elicit incorrect predictions. Researchers hope that models trained on these more challenging datasets will rely…

Computation and Language · Computer Science 2021-06-03 Divyansh Kaushik , Douwe Kiela , Zachary C. Lipton , Wen-tau Yih

Deception plays a key role in adversarial or strategic interactions for the purpose of self-defence and survival. This paper introduces a general framework and solution to address deception. Most existing approaches for deception consider…

Artificial Intelligence · Computer Science 2019-04-26 Bo Wu , Murat Cubuktepe , Suda Bharadwaj , Ufuk Topcu