English
Related papers

Related papers: Manipulating Trajectory Prediction with Backdoors

200 papers

In normal on-road situations, autonomous vehicles will be expected to have smooth trajectories with relatively little demand on the vehicle dynamics to ensure passenger comfort and driving safety. However, the occurrence of unexpected…

Systems and Control · Computer Science 2017-06-26 Florent Altché , Philip Polack , Arnaud de La Fortelle

Being able to anticipate the motion of surrounding agents is essential for the safe operation of autonomous driving systems in dynamic situations. While various methods have been proposed for trajectory prediction, the current evaluation…

Robotics · Computer Science 2025-12-16 Longchao Da , David Isele , Hua Wei , Manish Saroya

In a backdoor attack, an adversary inserts maliciously constructed backdoor examples into a training set to make the resulting model vulnerable to manipulation. Defending against such attacks typically involves viewing these inserted…

Cryptography and Security · Computer Science 2023-07-20 Alaa Khaddaj , Guillaume Leclerc , Aleksandar Makelov , Kristian Georgiev , Hadi Salman , Andrew Ilyas , Aleksander Madry

We examine the impact of adversarial actions on vehicles in traffic. Current advances in assisted/autonomous driving technologies are supposed to reduce the number of casualties, but this seems to be desired despite the recently proved…

Cryptography and Security · Computer Science 2017-01-27 Bogdan Groza

Machine learning models are routinely deployed on a wide range of computing hardware. Although such hardware is typically expected to produce identical results, differences in its design can lead to small numerical variations during…

Machine Learning · Computer Science 2026-02-03 Jonas Möller , Erik Imgrund , Thorsten Eisenhofer , Konrad Rieck

To improve safety and energy efficiency, autonomous vehicles are expected to drive smoothly in most situations, while maintaining their velocity below a predetermined speed limit. However, some scenarios such as low road adherence or…

Systems and Control · Computer Science 2017-04-05 Florent Altché , Philip Polack , Arnaud de la Fortelle

Backdoor attack is a major threat to deep learning systems in safety-critical scenarios, which aims to trigger misbehavior of neural network models under attacker-controlled conditions. However, most backdoor attacks have to modify the…

Machine Learning · Computer Science 2023-08-24 Yizhen Yuan , Rui Kong , Shenghao Xie , Yuanchun Li , Yunxin Liu

Data-driven neural path planners are attracting increasing interest in the robotics community. However, their neural network components typically come as black boxes, obscuring their underlying decision-making processes. Their black-box…

Robotics · Computer Science 2024-04-12 Zikang Xiong , Suresh Jagannathan

Accurate motion prediction of surrounding traffic participants is crucial for the safe and efficient operation of automated vehicles in dynamic environments. Marginal prediction models commonly forecast each agent's future trajectories…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Fabian Konstantinidis , Ariel Dallari Guerreiro , Raphael Trumpp , Moritz Sackmann , Ulrich Hofmann , Marco Caccamo , Christoph Stiller

Accurately predicting the trajectory of surrounding vehicles is a critical challenge for autonomous vehicles. In complex traffic scenarios, there are two significant issues with the current autonomous driving system: the cognitive…

Robotics · Computer Science 2024-09-25 Wen Wei , Jiankun Wang

Modern autonomous vehicles adopt state-of-the-art DNN models to interpret the sensor data and perceive the environment. However, DNN models are vulnerable to different types of adversarial attacks, which pose significant risks to the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Xingshuo Han , Guowen Xu , Yuan Zhou , Xuehuan Yang , Jiwei Li , Tianwei Zhang

Adversarial machine learning has exposed several security hazards of neural models and has become an important research topic in recent times. Thus far, the concept of an "adversarial perturbation" has exclusively been used with reference…

Machine Learning · Computer Science 2020-09-22 Siddhant Garg , Adarsh Kumar , Vibhor Goel , Yingyu Liang

The vision of automated driving is to increase both road safety and efficiency, while offering passengers a convenient travel experience. This requires that autonomous systems correctly estimate the current traffic scene and its likely…

Machine Learning · Computer Science 2019-07-26 David Augustin , Marius Hofmann , Ulrich Konigorski

DNNs' demand for massive data forces practitioners to collect data from the Internet without careful check due to the unacceptable cost, which brings potential risks of backdoor attacks. A backdoored model always predicts a target class in…

Machine Learning · Computer Science 2022-02-23 Yinghua Gao , Dongxian Wu , Jingfeng Zhang , Guanhao Gan , Shu-Tao Xia , Gang Niu , Masashi Sugiyama

World models - learned internal simulators of environment dynamics - are rapidly becoming foundational to autonomous decision-making in robotics, autonomous vehicles, and agentic AI. By predicting future states in compressed latent spaces,…

Cryptography and Security · Computer Science 2026-04-08 Manoj Parmar

It is commonplace to produce application-specific models by fine-tuning large pre-trained models using a small bespoke dataset. The widespread availability of foundation model checkpoints on the web poses considerable risks, including the…

Cryptography and Security · Computer Science 2024-04-02 Yuxin Wen , Leo Marchyok , Sanghyun Hong , Jonas Geiping , Tom Goldstein , Nicholas Carlini

As autonomous driving technology progresses, the need for precise trajectory prediction models becomes paramount. This paper introduces an innovative model that infuses cognitive insights into trajectory prediction, focusing on perceived…

We conduct a systematic study of backdoor vulnerabilities in normally trained Deep Learning models. They are as dangerous as backdoors injected by data poisoning because both can be equally exploited. We leverage 20 different types of…

Cryptography and Security · Computer Science 2022-11-30 Guanhong Tao , Zhenting Wang , Siyuan Cheng , Shiqing Ma , Shengwei An , Yingqi Liu , Guangyu Shen , Zhuo Zhang , Yunshu Mao , Xiangyu Zhang

Multivariate Time Series (MTS) forecasting is a fundamental task with numerous real-world applications, such as transportation, climate, and epidemiology. While a myriad of powerful deep learning models have been developed for this task,…

Machine Learning · Computer Science 2024-10-04 Xiao Lin , Zhining Liu , Dongqi Fu , Ruizhong Qiu , Hanghang Tong

Backdoors are hidden behaviors that are only triggered once an AI system has been deployed. Bad actors looking to create successful backdoors must design them to avoid activation during training and evaluation. Since data used in these…

Cryptography and Security · Computer Science 2024-12-25 Sara Price , Arjun Panickssery , Sam Bowman , Asa Cooper Stickland