English
Related papers

Related papers: COMMIT: Certifying Robustness of Multi-Sensor Fusi…

200 papers

Reliable detection and tracking of surrounding objects are indispensable for comprehensive motion prediction and planning of autonomous vehicles. Due to the limitations of individual sensors, the fusion of multiple sensor modalities is…

Robotics · Computer Science 2023-10-13 Phillip Karle , Felix Fent , Sebastian Huch , Florian Sauerbeck , Markus Lienkamp

Deep neural networks for natural language processing are fragile in the face of adversarial examples -- small input perturbations, like synonym substitution or word duplication, which cause a neural network to change its prediction. We…

Machine Learning · Computer Science 2021-09-08 Yuhao Zhang , Aws Albarghouthi , Loris D'Antoni

Multimodal fusion requires integrating information from multiple sources that may conflict depending on context. Existing fusion approaches typically rely on static assumptions about source reliability, limiting their ability to resolve…

Machine Learning · Computer Science 2026-03-30 Pranuthi Tenali , Sahil Sidheekh , Saurabh Mathur , Erik Blasch , Kristian Kersting , Sriraam Natarajan

Collaborative perception integrates multi-agent perspectives to enhance the sensing range and overcome occlusion issues. While existing multimodal approaches leverage complementary sensors to improve performance, they are highly prone to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Jiageng Wen , Shengjie Zhao , Bing Li , Jiafeng Huang , Kenan Ye , Hao Deng

It is now well-known that automatic speaker verification (ASV) systems can be spoofed using various types of adversaries. The usual approach to counteract ASV systems against such attacks is to develop a separate spoofing countermeasure…

Cryptography and Security · Computer Science 2024-01-30 Xuechen Liu , Md Sahidullah , Kong Aik Lee , Tomi Kinnunen

Lidar-based SLAM systems are highly sensitive to adverse conditions such as occlusion, noise, and field-of-view (FoV) degradation, yet existing robustness evaluation methods either lack physical grounding or do not capture sensor-specific…

Robotics · Computer Science 2025-12-10 Doumegna Mawuto Koudjo Felix , Xianjia Yu , Zhuo Zou , Tomi Westerlund

Multimodal sarcasm detection (MSD) aims to identify sarcastic intent from semantic incongruity between text and image. Although recent methods have improved MSD through cross-modal interaction and incongruity reasoning, most still treat…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Zhenyu Wang , Weichen Cheng , Weijia Li , Junjie Mou , Zongyou Zhao , Guoying Zhang

The existence of real-world adversarial examples (commonly in the form of patches) poses a serious threat for the use of deep learning models in safety-critical computer vision tasks such as visual perception in autonomous driving. This…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Giulio Rossolini , Federico Nesti , Gianluca D'Amico , Saasha Nair , Alessandro Biondi , Giorgio Buttazzo

Despite their impressive capabilities, Multimodal Large Language Models (MLLMs) exhibit perceptual fragility when confronted with visually complex scenes. This weakness stems from a reliance on finite training datasets, which are…

Machine Learning · Computer Science 2026-03-05 Yicheng Bao , Xuhong Wang , Qiaosheng Zhang , Chaochao Lu , Xia Hu , Xin Tan

Traditional vision-based material perception methods often experience substantial performance degradation under visually impaired conditions, thereby motivating the shift toward non-visual multimodal material perception. Despite this,…

Machine Learning · Computer Science 2025-11-26 Kailin Lyu , Long Xiao , Jianing Zeng , Junhao Dong , Xuexin Liu , Zhuojun Zou , Haoyue Yang , Lin Shu , Jie Hao

Safety validation is a crucial component in the development and deployment of autonomous systems, such as self-driving vehicles and robotic systems. Ensuring safe operation necessitates extensive testing and verification of control…

Systems and Control · Electrical Eng. & Systems 2023-05-11 Ali Baheri , Mykel J. Kochenderfer

Certified robustness circumvents the fragility of defences against adversarial attacks, by endowing model predictions with guarantees of class invariance for attacks up to a calculated size. While there is value in these certifications, the…

Machine Learning · Computer Science 2023-09-21 Andrew C. Cullen , Paul Montague , Shijie Liu , Sarah M. Erfani , Benjamin I. P. Rubinstein

As three-dimensional (3D) data acquisition devices become increasingly prevalent, the demand for 3D point cloud transmission is growing. In this study, we introduce a semantic-aware communication system for robust point cloud classification…

Signal Processing · Electrical Eng. & Systems 2023-06-26 Tianxiao Han , Kaiyi Chi , Qianqian Yang , Zhiguo Shi

We introduce a comprehensive framework for the detection and demodulation of covert electromagnetic signals using solid-state spin sensors. Our approach, named RAPID, is a two-stage hybrid strategy that leverages nitrogen-vacancy (NV)…

Quantum Physics · Physics 2025-09-11 Amirhossein Taherpour , Abbas Taherpour , Tamer Khattab

Reliable unmanned aerial vehicle (UAV) detection is critical for autonomous airspace monitoring but remains challenging when integrating sensor streams that differ substantially in resolution, perspective, and field of view. Conventional…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Ishrat Jahan , Molla E Majid , M Murugappan , Muhammad E. H. Chowdhury , N. B. Prakash , Saad Bin Abul Kashem , Balamurugan Balusamy , Amith Khandakar

In this paper, we propose to make a systematic study on machines multisensory perception under attacks. We use the audio-visual event recognition task against multimodal adversarial attacks as a proxy to investigate the robustness of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Yapeng Tian , Chenliang Xu

Discovering potential failures of an autonomous system is important prior to deployment. Falsification-based methods are often used to assess the safety of such systems, but the cost of running many accurate simulation can be high. The…

Robotics · Computer Science 2023-10-03 Marc R. Schlichting , Nina V. Boord , Anthony L. Corso , Mykel J. Kochenderfer

Accurate classification of medical device risk levels is essential for regulatory oversight and clinical safety. We present a Transformer-based multimodal framework that integrates textual descriptions and visual information to predict…

Machine Learning · Computer Science 2025-05-02 Yu Han , Aaron Ceross , Jeroen H. M. Bergmann

Recent advances in large vision-language models (VLMs) have demonstrated remarkable success across a wide range of visual understanding tasks. However, the robustness of these models against jailbreak attacks remains an open challenge. In…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Xiangyu Yin , Jiaxu Liu , Zhen Chen , Jinwei Hu , Yi Dong , Xiaowei Huang , Wenjie Ruan

Robustness in Simultaneous Localization and Mapping (SLAM) remains one of the key challenges for the real-world deployment of autonomous systems. SLAM research has seen significant progress in the last two and a half decades, yet many…