English
Related papers

Related papers: Edge-Based Multimodal Sensor Data Fusion with Visi…

200 papers

The rapid growth of ego-centric dashcam footage presents a major challenge for detecting safety-critical events such as collisions and near-collisions, scenarios that are brief, rare, and difficult for generic vision models to capture.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Mohammad Qazim Bhat , Yufan Huang , Niket Agarwal , Hao Wang , Michael Woods , John Kenyon , Tsung-Yi Lin , Xiaodong Yang , Ming-Yu Liu , Kevin Xie

End-to-end autonomous driving (E2E-AD) has emerged as a promising paradigm that unifies perception, prediction, and planning into a holistic, data-driven framework. However, achieving robustness to varying camera viewpoints, a common…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Hoonhee Cho , Jae-Young Kang , Giwon Lee , Hyemin Yang , Heejun Park , Seokwoo Jung , Kuk-Jin Yoon

Exploring open-world situations in an end-to-end manner is a promising yet challenging task due to the need for strong generalization capabilities. In particular, end-to-end autonomous driving in unstructured outdoor environments often…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Hyunki Seong , Seongwoo Moon , Hojin Ahn , Jehun Kang , David Hyunchul Shim

In this paper, we investigate the application of Vehicle-to-Everything (V2X) communication to improve the perception performance of autonomous vehicles. We present a robust cooperative perception framework with V2X communication using a…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Runsheng Xu , Hao Xiang , Zhengzhong Tu , Xin Xia , Ming-Hsuan Yang , Jiaqi Ma

Accurate and reliable object detection is critical for ensuring the safety and efficiency of Connected Autonomous Vehicles (CAVs). Traditional on-board perception systems have limited accuracy due to occlusions and blind spots, while…

Robotics · Computer Science 2025-09-25 Everett Richards , Bipul Thapa , Lena Mashayekhy

Accurately and promptly predicting accidents among surrounding traffic agents from camera footage is crucial for the safety of autonomous vehicles (AVs). This task presents substantial challenges stemming from the unpredictable nature of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Haicheng Liao , Haoyu Sun , Huanming Shen , Chengyue Wang , Kahou Tam , Chunlin Tian , Li Li , Chengzhong Xu , Zhenning Li

Controlling turbulent dynamics remains a major challenge because of its chaotic, multi-scale dynamics, which strongly influence the performance of many fluid systems. Here we report REACT (Reinforcement Learning for Environmental Adaptation…

Fluid Dynamics · Physics 2026-05-18 Junjie Zhang , Chengwei Xia , Xianyang Jiang , Isabella Fumarola , Georgios Rigas

Collision avoidance systems can play a vital role in reducing the number of accidents and saving human lives. In this paper, we introduce and validate a novel method for vehicles reactive collision avoidance using evolutionary neural…

Neural and Evolutionary Computing · Computer Science 2016-09-28 Hesham Eraqi , Youssef EmadEldin , Mohamed Moustafa

Autonomous robots operating in dynamic environments should identify and report anomalies. Embodying proactive mitigation improves safety and operational continuity. This paper presents a multimodal anomaly detection and mitigation system…

Robotics · Computer Science 2025-09-09 Oluwadamilola Sotomi , Devika Kodi , Kiruthiga Chandra Shekar , Aliasghar Arab

In this era of technological advancements, several cutting-edge techniques are being implemented to enhance Autonomous Driving (AD) systems, focusing on improving safety, efficiency, and adaptability in complex driving environments.…

Computation and Language · Computer Science 2025-02-27 Md Robiul Islam

This paper introduces a real-time Vehicle Collision Avoidance System (V-CAS) designed to enhance vehicle safety through adaptive braking based on environmental perception. V-CAS leverages the advanced vision-based transformer model RT-DETR,…

Robotics · Computer Science 2025-05-28 Muhammad Waqas Ashraf , Ali Hassan , Imad Ali Shah

The fusion of multimodal sensor data streams such as camera images and lidar point clouds plays an important role in the operation of autonomous vehicles (AVs). Robust perception across a range of adverse weather and lighting conditions is…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Shounak Sural , Nishad Sahu , Ragunathan Rajkumar

Autonomous driving systems rely on panoptic driving perception that requires both precision and real-time performance. In this work, we propose RMT-PPAD, a real-time, transformer-based multi-task model that jointly performs object…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Jiayuan Wang , Q. M. Jonathan Wu , Katsuya Suto , Ning Zhang

Collision risk estimation and avoidance play central roles in the safety of autonomous driving (AD) systems. Recently emerged end-to-end AD systems gain collision avoidance ability by minimizing losses to penalize planning trajectories that…

Robotics · Computer Science 2026-02-10 Ziliang Xiong , Shipeng Liu , Nathaniel Helgesen , Hongwei Li , Joakim Johnander , Per-Erik Forssen

Autonomous driving requires a comprehensive understanding of the surrounding environment for reliable trajectory planning. Previous works rely on dense rasterized scene representation (e.g., agent occupancy and semantic map) to perform…

Recent advancements in vision foundation models (VFMs) have revolutionized visual perception in 2D, yet their potential for 3D scene understanding, particularly in autonomous driving applications, remains underexplored. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Lingdong Kong , Xiang Xu , Youquan Liu , Jun Cen , Runnan Chen , Wenwei Zhang , Liang Pan , Kai Chen , Ziwei Liu

Ensuring both safety and efficiency in decision-making for autonomous driving systems remains a fundamental challenge. Traditional Deep Reinforcement Learning (DRL) suffers from unsafe random exploration and slow convergence, while Large…

Robotics · Computer Science 2026-05-28 Kangyu Wu , Peng Cui , Guoxi Chen , Ya Zhang

Traditional augmented reality (AR) systems predominantly rely on fixed class detectors or fiducial markers, limiting their ability to interpret complex, open-vocabulary natural language queries. We present a modular AR agent system that…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Lixing Guo , Tobias Höllerer

The evolution of autonomous driving towards full automation demands robust interactive capabilities; however, the development of Vision-Language-Action (VLA) models is constrained by the sparsity of interactive scenarios and inadequate…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Haojie Feng , Peizhi Zhang , Mengjie Tian , Xinrui Zhang , Zhuoren Li , Junpeng Huang , Xiurong Wang , Junfan Zhu , Jianzhou Wang , Dongxiao Yin , Lu Xiong

Autonomous driving (AD) technology promises to revolutionize daily transportation by making it safer, more efficient, and more comfortable. Their role in reducing traffic accidents and improving mobility will be vital to the future of…

Robotics · Computer Science 2024-11-19 Sonda Fourati , Wael Jaafar , Noura Baccar