English
Related papers

Related papers: Attention Misses Visual Risk: Risk-Adaptive Steeri…

200 papers

Large Language Models (LLMs) have evolved into Multimodal Large Language Models (MLLMs), significantly enhancing their capabilities by integrating visual information and other types, thus aligning more closely with the nature of human…

Cryptography and Security · Computer Science 2025-06-03 Youze Wang , Wenbo Hu , Yinpeng Dong , Jing Liu , Hanwang Zhang , Richang Hong

Navigating urban intersections, especially when interacting with heterogeneous traffic participants, presents a formidable challenge for autonomous vehicles (AVs). In such environments, safety risks arise simultaneously from multiple…

Systems and Control · Electrical Eng. & Systems 2026-01-30 Yuansheng Lian , Ke Zhang , Yaming Guo , Shen Li , Meng Li

Autonomous driving in complex traffic requires reasoning under uncertainty. Common approaches rely on prediction-based planning or risk-aware control, but these are typically treated in isolation, limiting their ability to capture the…

Robotics · Computer Science 2026-03-17 Devodita Chakravarty , John Dolan , Yiwei Lyu

Heterogeneous multi-modal remote sensing object detection aims to accurately detect objects from diverse sensors (e.g., RGB, SAR, Infrared). Existing approaches largely adopt a late alignment paradigm, in which modality alignment and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yuxuan Li , Yuming Chen , Yunheng Li , Ming-Ming Cheng , Xiang Li , Jian Yang

Multimodal Language Models (MMLMs) typically undergo post-training alignment to prevent harmful content generation. However, these alignment stages focus primarily on the assistant role, leaving the user role unaligned, and stick to a fixed…

Cryptography and Security · Computer Science 2025-04-08 Erfan Shayegani , G M Shahariar , Sara Abdali , Lei Yu , Nael Abu-Ghazaleh , Yue Dong

Multimodal learning has shown significant superiority on various tasks by integrating multiple modalities. However, the interdependencies among modalities increase the susceptibility of multimodal models to adversarial attacks. Existing…

Machine Learning · Computer Science 2025-11-25 Junrui Zhang , Xinyu Zhao , Jie Peng , Chenjie Wang , Jianmin Ji , Tianlong Chen

Lifelong multimodal agents must continuously adapt to new tasks through post-training, but this creates a fundamental tension between acquiring capabilities and preserving safety alignment. We demonstrate that fine-tuning aligned…

Artificial Intelligence · Computer Science 2026-03-17 Idhant Gulati , Shivam Raval

Large vision-language models (LVLMs) are increasingly deployed in globally distributed applications, such as tourism assistants, yet their ability to produce culturally appropriate responses remains underexplored. Existing multimodal safety…

Computation and Language · Computer Science 2025-12-23 Haoyi Qiu , Kung-Hsiang Huang , Ruichen Zheng , Jiao Sun , Nanyun Peng

For machine learning components used as part of autonomous systems (AS) in carrying out critical tasks it is crucial that assurance of the models can be maintained in the face of post-deployment changes (such as changes in the operating…

Machine Learning · Computer Science 2024-06-25 Ozan Vardal , Richard Hawkins , Colin Paterson , Chiara Picardi , Daniel Omeiza , Lars Kunze , Ibrahim Habli

Early screening for anxiety and appropriate interventions are essential to reduce the incidence of self-harm and suicide in patients. Due to limited medical resources, traditional methods that overly rely on physician expertise and…

Machine Learning · Computer Science 2023-03-17 Haimiao Mo , Shuai Ding , Siu Cheung Hui

Accurate classification of medical device risk levels is essential for regulatory oversight and clinical safety. We present a Transformer-based multimodal framework that integrates textual descriptions and visual information to predict…

Machine Learning · Computer Science 2025-05-02 Yu Han , Aaron Ceross , Jeroen H. M. Bergmann

Multi-modal Large Language Models (MLLMs) are increasingly deployed in interactive applications. However, their safety vulnerabilities become pronounced in multi-turn multi-modal scenarios, where harmful intent can be gradually…

Computation and Language · Computer Science 2026-01-09 Han Zhu , Jiale Chen , Chengkun Cai , Shengjie Sun , Haoran Li , Yujin Zhou , Chi-Min Chan , Pengcheng Wen , Lei Li , Sirui Han , Yike Guo

Distracted driving continues to be a significant cause of road traffic injuries and fatalities worldwide, even with advancements in driver monitoring technologies. Recent developments in machine learning (ML) and deep learning (DL) have…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Anthony Dontoh , Stephanie Ivey , Logan Sirbaugh , Andrews Danyo , Armstrong Aboah

LiDAR-to-OpenStreetMap (OSM) localization has gained increasing attention, as OSM provides lightweight global priors such as building footprints. These priors enhance global consistency for robot navigation, but OSM is often incomplete or…

Robotics · Computer Science 2025-09-16 Jianping Li , Kaisong Zhu , Zhongyuan Liu , Rui Jin , Xinhang Xu , Pengfei Wan , Lihua Xie

The rapid development of Multimodal Large Reasoning Models (MLRMs) has demonstrated broad application potential, yet their safety and reliability remain critical concerns that require systematic exploration. To address this gap, we conduct…

Computation and Language · Computer Science 2025-10-14 Xinyue Lou , You Li , Jinan Xu , Xiangyu Shi , Chi Chen , Kaiyu Huang

Trip hazards are a significant contributor to accidents on construction and manufacturing sites, where over a third of Australian workplace injuries occur [1]. Current safety inspections are labour intensive and limited by human…

Robotics · Computer Science 2017-06-22 Sean McMahon , Niko Sünderhauf , Ben Upcroft , Michael Milford

The multi-robot adaptive sampling problem aims at finding trajectories for a team of robots to efficiently sample the phenomenon of interest within a given endurance budget of the robots. In this paper, we propose a robust and scalable…

Robotics · Computer Science 2023-03-02 Lishuo Pan , Sandeep Manjanna , M. Ani Hsieh

Ensuring functional safety is essential for the deployment of Embodied AI in complex open-world environments. However, traditional Hazard Analysis and Risk Assessment (HARA) methods struggle to scale in this domain. While HARA relies on…

Robotics · Computer Science 2026-02-10 Dongsheng Chen , Yuxuan Li , Yi Lin , Guanhua Chen , Jiaxin Zhang , Xiangyu Zhao , Lei Ma , Xin Yao , Xuetao Wei

Industrial anomaly detection has attracted significant attention as a fundamental challenge in industrial systems. The rapid advancement of heterogeneous industrial sensors has driven industrial anomaly detection from unimodal to multimodal…

Machine Learning · Computer Science 2026-05-26 Heqiang Wang , Weihong Yang , Zheyuan Yang , Jia Zhou , Xiaoxiong Zhong , Fangming Liu , Weizhe Zhang

Vulnerable road users (VRUs) face high collision risks in mixed traffic, yet most existing safety systems prioritize driver or vehicle assistance over direct VRU support. This paper presents ARCAS, a real-time augmented reality (AR)…

Systems and Control · Electrical Eng. & Systems 2026-02-03 Ahmad Yehia , Jiseop Byeon , Tianyi Wang , Huihai Wang , Yiming Xu , Junfeng Jiao , Christian Claudel