English
Related papers

Related papers: Automatic Testing With Reusable Adversarial Agents

200 papers

As autonomous agents become more powerful and widely used, it is becoming increasingly important to ensure they behave safely and stay aligned with system goals, especially in multi-agent settings. Current systems often rely on agents…

Multiagent Systems · Computer Science 2025-04-08 Sagar Tamang , Dibya Jyoti Bora

Unlike reinforcement learning (RL) agents, humans remain capable multitaskers in changing environments. In spite of only experiencing the world through their own observations and interactions, people know how to balance focusing on tasks…

Artificial Intelligence · Computer Science 2024-07-02 Rishav Bhagat , Jonathan Balloch , Zhiyu Lin , Julia Kim , Mark Riedl

Autonomous vehicles (AVs) rely on complex perception and communication systems, making them vulnerable to adversarial attacks that can compromise safety. While simulation offers a scalable and safe environment for robustness testing,…

Cryptography and Security · Computer Science 2025-09-09 Christos Anagnostopoulos , Ioulia Kapsali , Alexandros Gkillas , Nikos Piperigkos , Aris S. Lalos

This paper focuses on safety performance testing and characterization of black-box highly automated vehicles (HAV). Existing testing approaches typically obtain the testing outcomes by deploying the HAV into a specific testing environment.…

Robotics · Computer Science 2024-02-05 Minghao Zhu , Anmol Sidhu , Keith A. Redmill

Generating safety-critical scenarios in high-fidelity simulations offers a promising and cost-effective approach for efficient testing of autonomous vehicles. Existing methods typically rely on manipulating a single vehicle's trajectory…

Machine Learning · Computer Science 2025-05-07 Jiawei Wang , Xintao Yan , Yao Mu , Haowei Sun , Zhong Cao , Henry X. Liu

Current validation methods often rely on recorded data and basic functional checks, which may not be sufficient to encompass the scenarios an autonomous vehicle might encounter. In addition, there is a growing need for complex scenarios…

Robotics · Computer Science 2024-02-08 Marc Kaufeld , Rainer Trauth , Johannes Betz

Seamlessly interacting with humans or robots is hard because these agents are non-stationary. They update their policy in response to the ego agent's behavior, and the ego agent must anticipate these changes to co-adapt. Inspired by humans,…

Robotics · Computer Science 2020-11-16 Annie Xie , Dylan P. Losey , Ryan Tolsma , Chelsea Finn , Dorsa Sadigh

A major challenge in autonomous vehicle research is modeling agent behaviors, which has critical applications including constructing realistic and reliable simulations for off-board evaluation and forecasting traffic agents motion for…

Artificial Intelligence · Computer Science 2024-09-30 Zhenghao Peng , Wenjie Luo , Yiren Lu , Tianyi Shen , Cole Gulino , Ari Seff , Justin Fu

Simulation environments are good for learning different driving tasks like lane changing, parking or handling intersections etc. in an abstract manner. However, these simulation environments often restrict themselves to operate under…

Machine Learning · Computer Science 2021-11-01 Ashish Rana , Avleen Malhi

This work in progress considers reachability-based safety analysis in the domain of autonomous driving in multi-agent systems. We formulate the safety problem for a car following scenario as a differential game and study how different…

Systems and Control · Electrical Eng. & Systems 2021-12-30 Gilbert Bahati , Marsalis Gibson , Alexandre Bayen

Human behaviors are regularized by a variety of norms or regulations, either to maintain orders or to enhance social welfare. If artificially intelligent (AI) agents make decisions on behalf of human beings, we would hope they can also…

Computer Science and Game Theory · Computer Science 2019-10-28 Fan-Yun Sun , Yen-Yu Chang , Yueh-Hua Wu , Shou-De Lin

Agent-based modelling is a powerful tool when simulating human systems, yet when human behaviour cannot be described by simple rules or maximising one's own profit, we quickly reach the limits of this methodology. Machine learning has the…

Multiagent Systems · Computer Science 2022-01-21 Georg Jäger , Daniel Reisinger

Adversarial scenario generation is crucial for autonomous driving testing because it can efficiently simulate various challenge and complex traffic conditions. However, it is difficult to control current existing methods to generate desired…

Robotics · Computer Science 2024-08-27 Shuo Yang , Caojun Wang , Yuanjian Zhang , Yuming Yin , Yanjun Huang , Shengbo Eben Li , Hong Chen

Many challenges remain before AI agents can be deployed in real-world environments. However, one virtue of such environments is that they are inherently multi-agent and contain human experts. Using advanced social intelligence in such an…

Machine Learning · Computer Science 2025-08-22 Eric Ye , Ren Tao , Natasha Jaques

Robots deployed in real-world environments should operate safely in a robust manner. In scenarios where an "ego" agent navigates in an environment with multiple other "non-ego" agents, two modes of safety are commonly proposed --…

Robotics · Computer Science 2021-04-01 Chih-Yuan Chiu , David Fridovich-Keil , Claire J. Tomlin

In this paper, we describe an integrated framework for autonomous decision making in a dynamic and interactive environment. We model the interactions between the ego agent and its operating environment as a two-player dynamic game, and…

Artificial Intelligence · Computer Science 2019-09-19 Sisi Li , Nan Li , Anouck Girard , Ilya Kolmanovsky

Deep reinforcement learning methods have been widely used in recent years for autonomous vehicle's decision-making. A key issue is that deep neural networks can be fragile to adversarial attacks or other unseen inputs. In this paper, we…

Systems and Control · Electrical Eng. & Systems 2020-03-19 Songan Zhang , Huei Peng , Subramanya Nageshrao , H. Eric Tseng

Simulation-based verification is beneficial for assessing otherwise dangerous or costly on-road testing of autonomous vehicles (AV). This paper addresses the challenge of efficiently generating effective tests for simulation-based AV…

Multiagent Systems · Computer Science 2020-08-31 Greg Chance , Abanoub Ghobrial , Severin Lemaignan , Tony Pipe , Kerstin Eder

With the adoption of autonomous vehicles on our roads, we will witness a mixed-autonomy environment where autonomous and human-driven vehicles must learn to co-exist by sharing the same road infrastructure. To attain socially-desirable…

Robotics · Computer Science 2025-12-11 Behrad Toghi , Rodolfo Valiente , Dorsa Sadigh , Ramtin Pedarsani , Yaser P. Fallah

The technology for autonomous vehicles is close to replacing human drivers by artificial systems endowed with high-level decision-making capabilities. In this regard, systems must learn about the usual vehicle's behavior to predict imminent…

Image and Video Processing · Electrical Eng. & Systems 2020-04-22 Mahdyar Ravanbakhsh , Mohamad Baydoun , Damian Campo , Pablo Marin , David Martin , Lucio Marcenaro , andCarlo Regazzoni