English
Related papers

Related papers: Foundation Models for Autonomous Driving Perceptio…

200 papers

Transformer-based models are becoming a central paradigm in autonomous driving because they can capture long-range spatial dependencies, multi-agent interactions, and multimodal context across perception, prediction, and planning. At the…

Machine Learning · Computer Science 2026-05-13 Juan Zhong , Yuhang Shi , Zukang Xu , Xi Chen

Deep learning-based intelligent vehicle perception has been developing prominently in recent years to provide a reliable source for motion planning and decision making in autonomous driving. A large number of powerful deep learning-based…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Xinyu Liu , Jinlong Li , Jin Ma , Huiming Sun , Zhigang Xu , Tianyun Zhang , Hongkai Yu

Multi-modal fusion is a fundamental task for the perception of an autonomous driving system, which has recently intrigued many researchers. However, achieving a rather good performance is not an easy task due to the noisy raw data,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Keli Huang , Botian Shi , Xiang Li , Xin Li , Siyuan Huang , Yikang Li

This paper analyzes the robustness of deep learning models in autonomous driving applications and discusses the practical solutions to address that.

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Mohammad Javad Shafiee , Ahmadreza Jeddi , Amir Nazemi , Paul Fieguth , Alexander Wong

Perception and prediction modules are critical components of autonomous driving systems, enabling vehicles to navigate safely through complex environments. The perception module is responsible for perceiving the environment, including…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Lucas Dal'Col , Miguel Oliveira , Vítor Santos

Panoptic perception represents a forefront advancement in autonomous driving technology, unifying multiple perception tasks into a singular, cohesive framework to facilitate a thorough understanding of the vehicle's surroundings. This…

Robotics · Computer Science 2024-08-29 Yunge Li , Lanyu Xu

In line with the development of deep learning, this survey examines the transformative role of Transformers and foundation models in advancing visual anomaly detection (VAD). We explore how these architectures, with their global receptive…

Machine Learning · Computer Science 2025-07-23 Mouïn Ben Ammar , Arturo Mendoza , Nacim Belkhir , Antoine Manzanera , Gianni Franchi

The foundational role of datasets in defining the capabilities of deep learning models has led to their rapid proliferation. At the same time, published research focusing on the process of dataset development for environment perception in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Felix Grün , Marcus Nolte , Markus Maurer

Time series data are ubiquitous across diverse real-world applications, making time series analysis critically important. Traditional approaches are largely task-specific, offering limited functionality and poor transferability. In recent…

Machine Learning · Computer Science 2025-09-18 Jiexia Ye , Yongzi Yu , Weiqi Zhang , Le Wang , Jia Li , Fugee Tsung

Deep learning has revolutionized autonomous driving by enabling vehicles to perceive and interpret their surroundings with remarkable accuracy. This progress is attributed to various deep learning models, including Mediated Perception,…

Robotics · Computer Science 2023-12-12 Hemanth Manjunatha , Panagiotis Tsiotras

Artificial Intelligence (AI) technologies have profoundly transformed the field of remote sensing, revolutionizing data collection, processing, and analysis. Traditionally reliant on manual interpretation and task-specific models, remote…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Siqi Lu , Junlin Guo , James R Zimmer-Dauphinee , Jordan M Nieusma , Xiao Wang , Parker VanValkenburgh , Steven A Wernke , Yuankai Huo

Modeling environmental ecosystems is essential for effective resource management, sustainable development, and understanding complex ecological processes. However, traditional data-driven methods face challenges in capturing inherently…

Machine Learning · Computer Science 2025-04-08 Runlong Yu , Shengyu Chen , Yiqun Xie , Huaxiu Yao , Jared Willard , Xiaowei Jia

The rise of large foundation models, trained on extensive datasets, is revolutionizing the field of AI. Models such as SAM, DALL-E2, and GPT-4 showcase their adaptability by extracting intricate patterns and performing effectively across…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Xu Yan , Haiming Zhang , Yingjie Cai , Jingming Guo , Weichao Qiu , Bin Gao , Kaiqiang Zhou , Yue Zhao , Huan Jin , Jiantao Gao , Zhen Li , Lihui Jiang , Wei Zhang , Hongbo Zhang , Dengxin Dai , Bingbing Liu

Multimodal foundation models offer promising advancements for enhancing driving perception systems, but their high computational and financial costs pose challenges. We develop a method that leverages foundation models to refine predictions…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Yunhao Yang , Yuxin Hu , Mao Ye , Zaiwei Zhang , Zhichao Lu , Yi Xu , Ufuk Topcu , Ben Snyder

Trajectory prediction serves as a critical functionality in autonomous driving, enabling the anticipation of future motion paths for traffic participants such as vehicles and pedestrians, which is essential for driving safety. Although…

Robotics · Computer Science 2025-09-16 Wei Dai , Shengen Wu , Wei Wu , Zhenhao Wang , Sisuo Lyu , Haicheng Liao , Limin Yu , Weiping Ding , Runwei Guan , Yutao Yue

We are motivated by the problem of autonomous vehicle performance validation. A key challenge is that an autonomous vehicle requires testing in every kind of driving scenario it could encounter, including rare events, to provide a strong…

Robotics · Computer Science 2025-06-02 Alec Farid , Peter Schleede , Aaron Huang , Christoffer Heckman

The last decade witnessed increasingly rapid progress in self-driving vehicle technology, mainly backed up by advances in the area of deep learning and artificial intelligence. The objective of this paper is to survey the current…

Machine Learning · Computer Science 2020-03-26 Sorin Grigorescu , Bogdan Trasnea , Tiberiu Cocias , Gigel Macesanu

Modeling environmental ecosystems is essential for effective resource management, sustainable development, and understanding complex ecological processes. However, traditional methods frequently struggle with the inherent complexity,…

Machine Learning · Computer Science 2025-03-06 Runlong Yu , Shengyu Chen , Yiqun Xie , Xiaowei Jia

Foundation models have become general-purpose assistants, exhibiting diverse capabilities across numerous domains through training on web-scale data. It remains challenging to precisely characterize even a fraction of the full spectrum of…

Machine Learning · Computer Science 2025-06-10 Cong Lu , Shengran Hu , Jeff Clune

Foundation models have revolutionized artificial intelligence, setting new benchmarks in performance and enabling transformative capabilities across a wide range of vision and language tasks. However, despite the prevalence of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Adam Goodge , Wee Siong Ng , Bryan Hooi , See Kiong Ng