English
Related papers

Related papers: Driving Behavior Explanation with Multi-level Fusi…

200 papers

Achieving human-like driving behaviors in complex open-world environments is a critical challenge in autonomous driving. Contemporary learning-based planning approaches such as imitation learning methods often struggle to balance competing…

This report outlines the concepts, mechanisms and inner dynamics of the BEAM (Behavior, Energy, Autonomy, and Mobility) modeling framework. BEAM is an open-source large-scale high-resolution transportation model that harnesses the…

Multiagent Systems · Computer Science 2023-08-07 Haitam Laarabi , Zachary Needell , Rashid Waraich , Cristian Poliziani , Tom Wenzel

Learning high-performance control policies that remain consistent with expert behavior is a fundamental challenge in robotics. Reinforcement learning can discover high-performing strategies but often departs from desirable human behavior,…

Robotics · Computer Science 2026-04-06 Siwei Ju , Jan Tauberschmidt , Oleg Arenz , Peter van Vliet , Jan Peters

Event classification is inherently sequential and multimodal. Therefore, deep neural models need to dynamically focus on the most relevant time window and/or modality of a video. In this study, we propose the Multi-level Attention Fusion…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Mathilde Brousmiche , Jean Rouat , Stéphane Dupont

This paper describes a novel method for allowing an autonomous ground vehicle to predict the intent of other agents in an urban environment. This method, termed the cognitive driving framework, models both the intent and the potentially…

Robotics · Computer Science 2015-04-02 Alan J. Hamlet , Carl D. Crane

The ability to predict the future trajectories of traffic participants is crucial for the safe and efficient operation of autonomous vehicles. In this paper, a diffusion-based generative model for multi-agent trajectory prediction is…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Theodor Westny , Björn Olofsson , Erik Frisk

Explainability of a classification model is crucial when deployed in real-world decision support systems. Explanations make predictions actionable to the user and should inform about the capabilities and limitations of the system. Existing…

Machine Learning · Computer Science 2022-12-13 Erwin Walraven , Ajaya Adhikari , Cor J. Veenman

Learning contextual and spatial environmental representations enhances autonomous vehicle's hazard anticipation and decision-making in complex scenarios. Recent perception systems enhance spatial understanding with sensor fusion but often…

Robotics · Computer Science 2024-01-18 Shoaib Azam , Farzeen Munir , Ville Kyrki , Moongu Jeon , Witold Pedrycz

For future human-autonomous vehicle (AV) interactions to be effective and smooth, human-aware systems that analyze and align human needs with automation decisions are essential. Achieving this requires systems that account for human…

Artificial Intelligence · Computer Science 2025-05-22 Zahra Zahedi , Shashank Mehrotra , Teruhisa Misu , Kumar Akash

Pedestrian behavior prediction is one of the major challenges for intelligent driving systems. Pedestrians often exhibit complex behaviors influenced by various contextual elements. To address this problem, we propose BiPed, a multitask…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Amir Rasouli , Mohsen Rohani , Jun Luo

The integration of Deep Learning (DL) in System Dynamics (SD) modeling for transportation logistics offers significant advantages in scalability and predictive accuracy. However, these gains are often offset by the loss of explainability…

Artificial Intelligence · Computer Science 2025-09-11 Riccardo D'Elia , Alberto Termine , Francesco Flammini

Hypergraph can capture complex and higher-order dependencies among learners and learning resources in personalized educational recommender systems. Many existing hypergraph-based recommendation approaches underexplored the dynamic…

Information Retrieval · Computer Science 2026-03-17 Tao Xie , Yan Li , Yongpan Sheng , Jian Liao

We explore Bird's-Eye View (BEV) generation, converting a BEV map into its corresponding multi-view street images. Valued for its unified spatial representation aiding multi-sensor fusion, BEV is pivotal for various autonomous driving…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Xiaojie Xu , Tianshuo Xu , Fulong Ma , Yingcong Chen

Connected and automated vehicles (CAVs) can be beneficial for improving the operation of highway bottlenecks such as weaving sections. This paper proposes a bi-level control approach based on an upper-level deep reinforcement learning…

Systems and Control · Electrical Eng. & Systems 2024-03-26 Longhao Yan , Jinhao Liang , Kaidi Yang

In mixed-traffic environments, autonomous vehicles (AVs) must interact with heterogeneous human-driven vehicles (HVs) whose intentions and driving styles vary across individuals and scenarios. Such variability introduces uncertainty into…

Robotics · Computer Science 2026-03-18 Xiaoyun Qiu , Haichao Liu , Yue Pan , Jun Ma , Xinhu Zheng

Accurately predicting future behaviors of surrounding vehicles is an essential capability for autonomous vehicles in order to plan safe and feasible trajectories. The behaviors of others, however, are full of uncertainties. Both rational…

Robotics · Computer Science 2019-07-25 Yeping Hu , Liting Sun , Masayoshi Tomizuka

Vision-language models enable the understanding and reasoning of complex traffic scenarios through multi-source information fusion, establishing it as a core technology for autonomous driving. However, existing vision-language models are…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Minghui Hou , Wei-Hsing Huang , Shaofeng Liang , Daizong Liu , Tai-Hao Wen , Gang Wang , Runwei Guan , Weiping Ding

For robotic vehicles to navigate robustly and safely in unseen environments, it is crucial to decide the most suitable navigation policy. However, most existing deep reinforcement learning based navigation policies are trained with a…

Robotics · Computer Science 2023-10-31 Kyowoon Lee , Seongun Kim , Jaesik Choi

Multi-modality fusion is the guarantee of the stability of autonomous driving systems. In this paper, we propose a general multi-modality cascaded fusion framework, exploiting the advantages of decision-level and feature-level fusion,…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Hongwu Kuang , Xiaodong Liu , Jingwei Zhang , Zicheng Fang

Inspired by human vision, we propose a new periphery-fovea multi-resolution driving model that predicts vehicle speed from dash camera videos. The peripheral vision module of the model processes the full video frames in low resolution. Its…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Ye Xia , Jinkyu Kim , John Canny , Karl Zipser , David Whitney