English
Related papers

Related papers: Toward Autonomous Laboratory Safety Monitoring wit…

200 papers

Vision-language models (VLMs) have recently emerged as powerful representation learning systems that align visual observations with natural language concepts, offering new opportunities for semantic reasoning in safety-critical autonomous…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Ross Greer , Maitrayee Keskar , Angel Martinez-Sanchez , Parthib Roy , Shashank Shriram , Mohan Trivedi

Large-scale Vision Language Models (LVLMs) exhibit advanced capabilities in tasks that require visual information, including object detection. These capabilities have promising applications in various industrial domains, such as autonomous…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Haruki Sakajo , Hiroshi Takato , Hiroshi Tsutsui , Komei Soda , Hidetaka Kamigaito , Taro Watanabe

Artificial Intelligence (AI) is revolutionizing scientific research, yet its growing integration into laboratory environments presents critical safety challenges. Large language models (LLMs) and vision language models (VLMs) now assist in…

The increasing integration of Visual Language Models (VLMs) into AI systems necessitates robust model alignment, especially when handling multimodal content that combines text and images. Existing evaluation datasets heavily lean towards…

Computation and Language · Computer Science 2026-03-05 Gabriel Downer , Sean Craven , Damian Ruck , Jake Thomas

Detecting anomalous hazards in visual data, particularly in video streams, is a critical challenge in autonomous driving. Existing models often struggle with unpredictable, out-of-label hazards due to their reliance on predefined object…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Shashank Shriram , Srinivasa Perisetla , Aryan Keskar , Harsha Krishnaswamy , Tonko Emil Westerhof Bossen , Andreas Møgelmose , Ross Greer

Safety hazard identification and prevention are the key elements of proactive safety management. Previous research has extensively explored the applications of computer vision to automatically identify hazards from image clips collected…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Muhammad Adil , Gaang Lee , Vicente A. Gonzalez , Qipei Mei

Large Vision Language Models (LVLMs) have shown strong capabilities in understanding and analyzing visual scenes across various domains. However, in the context of autonomous driving, their limited comprehension of 3D environments restricts…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Jannik Lübberstedt , Esteban Rivera , Nico Uhlemann , Markus Lienkamp

Recent advances in vision-language models (VLMs) have accelerated their application to indoor safety hazards assessment. However, existing benchmarks suffer from three fundamental limitations: (1) heavy reliance on synthetic datasets…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Qiucheng Yu , Ruijie Xu , Mingang Chen , Xuequan Lu , Jianfeng Dong , Chaochao Lu , Xin Tan

Benefiting from the powerful capabilities of Large Language Models (LLMs), pre-trained visual encoder models connected to an LLMs can realize Vision Language Models (VLMs). However, existing research shows that the visual modality of VLMs…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Zhendong Liu , Yuanbi Nie , Yingshui Tan , Xiangyu Yue , Qiushi Cui , Chongjun Wang , Xiaoyong Zhu , Bo Zheng

The widespread use of cameras in our society has created an overwhelming amount of video data, far exceeding the capacity for human monitoring. This presents a critical challenge for public safety and security, as the timely detection of…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Pascal Benschop , Cristian Meo , Justin Dauwels , Jelte P. Mense

The rapid advancement of vision-language models (VLMs) has brought a lot of attention to their safety alignment. However, existing methods have primarily focused on model undersafety, where the model responds to hazardous queries, while…

Information Retrieval · Computer Science 2025-05-28 Jiahui Geng , Qing Li , Zongxiong Chen , Yuxia Wang , Derui Zhu , Zhuohan Xie , Chenyang Lyu , Xiuying Chen , Preslav Nakov , Fakhri Karray

Multimodal large language models (MLLMs) face safety misalignment, where visual inputs enable harmful outputs. To address this, existing methods require explicit safety labels or contrastive data; yet, threat-related concepts are concrete…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Qishun Yang , Shu Yang , Lijie Hu , Di Wang

Construction safety inspections typically involve a human inspector identifying safety concerns on-site. With the rise of powerful Vision Language Models (VLMs), researchers are exploring their use for tasks such as detecting safety rule…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Xuezheng Chen , Zhengbo Zou

Vision-Language Models (VLMs) are increasingly proposed for autonomous driving tasks, yet their performance on sequential driving scenes remains poorly characterized, particularly regarding how input configurations affect their…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Roberto Brusnicki , Mattia Piccinini , Johannes Betz

Autonomous driving policy learning with reinforcement learning (RL) is fundamentally limited by low sample efficiency, weak generalization, and a dependence on unsafe online trial-and-error interactions. Although safe RL introduces explicit…

Robotics · Computer Science 2026-03-31 Yansong Qu , Zilin Huang , Zihao Sheng , Jiancong Chen , Yue Leng , Samuel Labi , Sikai Chen

Rapid deployment of vision-language models (VLMs) magnifies safety risks, yet most evaluations rely on artificial images. This study asks: How safe are current VLMs when confronted with meme images that ordinary users share? To investigate…

Computation and Language · Computer Science 2025-09-24 DongGeon Lee , Joonwon Jang , Jihae Jeong , Hwanjo Yu

Benefiting from the powerful capabilities of Large Language Models (LLMs), pre-trained visual encoder models connected to LLMs form Vision Language Models (VLMs). However, recent research shows that the visual modality in VLMs is highly…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Zhendong Liu , Yuanbi Nie , Yingshui Tan , Jiaheng Liu , Xiangyu Yue , Qiushi Cui , Chongjun Wang , Xiaoyong Zhu , Bo Zheng

Despite emerging efforts to enhance the safety of Vision-Language Models (VLMs), current approaches face two main shortcomings. 1) Existing safety-tuning datasets and benchmarks only partially consider how image-text interactions can yield…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Youngwan Lee , Kangsan Kim , Kwanyong Park , Ilcahe Jung , Soojin Jang , Seanie Lee , Yong-Ju Lee , Sung Ju Hwang

Autonomous driving systems face significant challenges in handling unpredictable edge-case scenarios, such as adversarial pedestrian movements, dangerous vehicle maneuvers, and sudden environmental changes. Current end-to-end driving models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Dianwei Chen , Zifan Zhang , Lei Cheng , Yuchen Liu , Xianfeng Terry Yang

The robust safety of Vision-Language Large Models (VLLMs) against joint multilingual and multimodal threats remains severely underexplored. Current benchmarks typically isolate these dimensions, being either multilingual but text-only, or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Enyi Shi , Pengyang Shao , Yanxin Zhang , Chenhang Cui , Jiayi Lyu , Xiaobo Xia , Fei Shen , Tat-Seng Chua
‹ Prev 1 2 3 10 Next ›