English
Related papers

Related papers: Multi-modality Anomaly Segmentation on the Road

200 papers

Multimodal semantic communication has great potential to enhance downstream task performance by integrating complementary information across modalities. This paper introduces ProMSC-MIS, a novel Prompt-based Multimodal Semantic…

Multimedia · Computer Science 2025-08-28 Haoshuo Zhang , Yufei Bo , Meixia Tao

Semantic segmentation is the problem of assigning a class label to every pixel in an image, and is an important component of an autonomous vehicle vision stack for facilitating scene understanding and object detection. However, many of the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Christopher J. Holder , Muhammad Shafique

Autonomous vehicles are the next revolution in the automobile industry and they are expected to revolutionize the future of transportation. Understanding the scenario in which the autonomous vehicle will operate is critical for its…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Naveen Mathews Renji , Kruthika K , Manasa Keshavamurthy , Pooja Kumari , S. Rajarajeswari

The detection of unknown traffic obstacles is vital to ensure safe autonomous driving. The standard object-detection methods cannot identify unknown objects that are not included under predefined categories. This is because object-detection…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Chihiro Noguchi , Toshiaki Ohgushi , Masao Yamanaka

Deep learning has enabled impressive progress in the accuracy of semantic segmentation. Yet, the ability to estimate uncertainty and detect failure is key for safety-critical applications like autonomous driving. Existing uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Hermann Blum , Paul-Edouard Sarlin , Juan Nieto , Roland Siegwart , Cesar Cadena

To improve logical anomaly detection, some previous works have integrated segmentation techniques with conventional anomaly detection methods. Although these methods are effective, they frequently lead to unsatisfactory segmentation results…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Yu-Hsuan Hsieh , Shang-Hong Lai

Anomaly segmentation aims to identify Out-of-Distribution (OoD) anomalous objects within images. Existing pixel-wise methods typically assign anomaly scores individually and employ a global thresholding strategy to segment anomalies.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Yuxing Liu , Ji Zhang , Zhou Xuchuan , Jingzhong Xiao , Huimin Yang , Jiaxin Zhong

Nowadays, there are outstanding strides towards a future with autonomous vehicles on our roads. While the perception of autonomous vehicles performs well under closed-set conditions, they still struggle to handle the unexpected. This survey…

Robotics · Computer Science 2025-11-25 Daniel Bogdoll , Maximilian Nitsche , J. Marius Zöllner

In this paper, we show how uncertainty estimation can be leveraged to enable safety critical image segmentation in autonomous driving, by triggering a fallback behavior if a target accuracy cannot be guaranteed. We introduce a new…

Computer Vision and Pattern Recognition · Computer Science 2021-05-31 Victor Besnier , David Picard , Alexandre Briot

When developing autonomous driving systems (ADS), developers often need to replay previously collected driving recordings to check the correctness of newly introduced changes to the system. However, simply replaying the entire recording is…

Software Engineering · Computer Science 2022-09-07 Yao Deng , Xi Zheng , Mengshi Zhang , Guannan Lou , Tianyi Zhang

We present a simple and practical framework for anomaly segmentation called Maskomaly. It builds upon mask-based standard semantic segmentation networks by adding a simple inference-time post-processing step which leverages the raw mask…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Jan Ackermann , Christos Sakaridis , Fisher Yu

Safe navigation of self-driving cars and robots requires a precise understanding of their environment. Training data for perception systems cannot cover the wide variety of objects that may appear during deployment. Thus, reliable…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Alexey Nekrasov , Rui Zhou , Miriam Ackermann , Alexander Hermans , Bastian Leibe , Matthias Rottmann

Anomaly detection from a driver's perspective when driving is important to autonomous vehicles. As a part of Advanced Driver Assistance Systems (ADAS), it can remind the driver about dangers timely. Compared with traditional studied scenes…

Computer Vision and Pattern Recognition · Computer Science 2019-05-01 Yuan Yuan , Dong Wang , Qi Wang

Segmentation of moving objects in dynamic scenes is a key process in scene understanding for navigation tasks. Classical cameras suffer from motion blur in such scenarios rendering them effete. On the contrary, event cameras, because of…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Chethan M. Parameshwara , Nitin J. Sanket , Chahat Deep Singh , Cornelia Fermüller , Yiannis Aloimonos

Off-road image semantic segmentation is challenging due to the presence of uneven terrains, unstructured class boundaries, irregular features and strong textures. These aspects affect the perception of the vehicle from which the information…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Kasi Viswanath , Kartikeya Singh , Peng Jiang , Sujit P. B. , Srikanth Saripalli

Malignant brain tumors have become an aggressive and dangerous disease that leads to death worldwide.Multi-modal MRI data is crucial for accurate brain tumor segmentation, but missing modalities common in clinical practice can severely…

Methodology · Statistics 2025-07-11 Guoyan Liang , Qin Zhou , Jingyuan Chen , Bingcang Huang , Kai Chen , Lin Gu , Zhe Wang , Sai Wu , Chang Yao

Artificial intelligence for autonomous driving must meet strict requirements on safety and robustness. We propose to validate machine learning models for self-driving vehicles not only with given ground truth labels, but also with…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Laura von Rueden , Tim Wirtz , Fabian Hueger , Jan David Schneider , Christian Bauckhage

We present a weakly-supervised approach to segmenting proposed drivable paths in images with the goal of autonomous driving in complex urban environments. Using recorded routes from a data collection vehicle, our proposed method generates…

Robotics · Computer Science 2017-11-20 Dan Barnes , Will Maddern , Ingmar Posner

In recent studies, numerous previous works emphasize the importance of semantic segmentation of LiDAR data as a critical component to the development of driver-assistance systems and autonomous vehicles. However, many state-of-the-art…

Knowing when a trained segmentation model is encountering data that is different to its training data is important. Understanding and mitigating the effects of this play an important part in their application from a performance and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 David S. W. Williams , Daniele De Martini , Matthew Gadd , Paul Newman