English
Related papers

Related papers: Multi-modal Integrated Prediction and Decision-mak…

200 papers

Trajectory prediction is a fundamental technology for advanced autonomous driving systems and represents one of the most challenging problems in the field of cognitive intelligence. Accurately predicting the future trajectories of each…

Robotics · Computer Science 2025-04-24 Qu Weiming , Wang Jia , Du Jiawei , Zhu Yuanhao , Yu Jianfeng , Xia Rui , Cao Song , Wu Xihong , Luo Dingsheng

End-to-end autonomous driving aims to generate safe and plausible planning policies from raw sensor input. Driving world models have shown great potential in learning rich representations by predicting the future evolution of a driving…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xingtai Gui , Meijie Zhang , Tianyi Yan , Wencheng Han , Jiahao Gong , Feiyang Tan , Cheng-zhong Xu , Jianbing Shen

This paper presents a method for constructing human-robot interaction policies in settings where multimodality, i.e., the possibility of multiple highly distinct futures, plays a critical role in decision making. We are motivated in this…

Robotics · Computer Science 2017-10-27 Edward Schmerling , Karen Leung , Wolf Vollprecht , Marco Pavone

Enabling physics-based humanoids to execute diverse behaviors from high-level textual commands remains a significant challenge. Existing methods typically follow either a two-stage paradigm that combines kinematic motion generation with…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Bin Li , Ruichi Zhang , Han Liang , Jingyan Zhang , Juze Zhang , Xin Chen , Jingya Wang

Addressing multiagent decision problems in AI, especially those involving collaborative or competitive agents acting concurrently in a partially observable and stochastic environment, remains a formidable challenge. While Interactive…

Multiagent Systems · Computer Science 2024-10-01 Yinghui Pan , Biyang Ma , Hanyi Zhang , Yifeng Zeng

Predicting agents' future trajectories plays a crucial role in modern AI systems, yet it is challenging due to intricate interactions exhibited in multi-agent systems, especially when it comes to collision avoidance. To address this…

Robotics · Computer Science 2021-03-29 Xu Xie , Chi Zhang , Yixin Zhu , Ying Nian Wu , Song-Chun Zhu

Generating multi-vehicle interaction scenarios can benefit motion planning and decision making of autonomous vehicles when on-road data is insufficient. This paper presents an efficient approach to generate varied multi-vehicle interaction…

Robotics · Computer Science 2019-10-10 Weiyang Zhang , Wenshuo Wang , Ding Zhao

Building a multi-modality multi-task neural network toward accurate and robust performance is a de-facto standard in perception task of autonomous driving. However, leveraging such data from multiple sensors to jointly optimize the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Tengju Ye , Wei Jing , Chunyong Hu , Shikun Huang , Lingping Gao , Fangzhen Li , Jingke Wang , Ke Guo , Wencong Xiao , Weibo Mao , Hang Zheng , Kun Li , Junbo Chen , Kaicheng Yu

Motion planning for autonomous driving must account for multi-modal uncertainty in both the intentions and trajectories of surrounding vehicles. Handling uncertainty in a worst-case manner guarantees robustness but often leads to excessive…

Robotics · Computer Science 2026-05-22 Zekun Xing , Ramkrishna Chaudhari , Marion Leibold , Dirk Wollherr , Martin Buss

Four-wheel Independent Steering (4WIS) vehicles have attracted increasing attention for their superior maneuverability. Human drivers typically choose to cross or drive over the low-profile obstacles (e.g., plastic bags) to efficiently…

Robotics · Computer Science 2026-04-08 Jingjia Teng , Yang Li , Yougang Bian , Manjiang Hu , Yingbai Hu , Guofa Li , Jianqiang Wang

Combining motion prediction and motion planning offers a promising framework for enhancing interactions between automated vehicles and other traffic participants. However, this introduces challenges in conditioning predictions on navigation…

Robotics · Computer Science 2025-12-04 Marlon Steiner , Royden Wagner , Ömer Sahin Tas , Christoph Stiller

Decision making whenever and wherever it is happened is key to organizations success. In order to make correct decision, individuals, teams and organizations need both knowledge management (to manage content) and collaboration (to manage…

Artificial Intelligence · Computer Science 2012-03-27 Nesrine Ben Yahia , Narjès Bellamine , Henda Ben Ghezala

Multi-modal learning has emerged as a key technique for improving performance across domains such as autonomous driving, robotics, and reasoning. However, in certain scenarios, particularly in resource-constrained environments, some…

Robotics · Computer Science 2026-01-01 Rui Liu , Yu Shen , Peng Gao , Pratap Tokekar , Ming Lin

Autonomous vehicles hold great promise in improving the future of transportation. The driving models used in these vehicles are based on neural networks, which can be difficult to validate. However, ensuring the safety of these models is…

Robotics · Computer Science 2023-09-14 Maximilian Zipfl , Sven Spickermann , J. Marius Zöllner

The success of smart environments largely depends on their smartness of understanding the environments' ongoing situations. Accordingly, this task is an essence to smart environment central processors. Obtaining knowledge from the…

Human-Computer Interaction · Computer Science 2019-06-25 Hossein Rajaby Faghihi , Mohammad Amin Fazli , Jafar Habibi

Operation in a real world traffic requires autonomous vehicles to be able to plan their motion in complex environments (multiple moving participants). Planning through such environment requires the right search space to be provided for the…

Robotics · Computer Science 2019-05-22 Jasprit Singh Gill , Pierluigi Pisu , Venkat N. Krovi , Matthias J. Schmid

Anticipating human actions is an important task that needs to be addressed for the development of reliable intelligent agents, such as self-driving cars or robot assistants. While the ability to make future predictions with high accuracy is…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Olga Zatsarynna , Yazan Abu Farha , Juergen Gall

Accurate trajectory prediction of road agents (e.g., pedestrians, vehicles) is an essential prerequisite for various intelligent systems applications, such as autonomous driving and robotic navigation. Recent research highlights the…

Artificial Intelligence · Computer Science 2025-03-10 Yihong Tang , Wei Ma

In this paper, a human-like driving framework is designed for autonomous vehicles (AVs), which aims to make AVs better integrate into the transportation ecology of human driving and eliminate the misunderstanding and incompatibility of…

Robotics · Computer Science 2022-01-14 Peng Hang , Yiran Zhang , Chen Lv

Multimodal learning, which integrates data from diverse sensory modes, plays a pivotal role in artificial intelligence. However, existing multimodal learning methods often struggle with challenges where some modalities appear more dominant…

Machine Learning · Computer Science 2024-04-02 Xiaohui Zhang , Jaehong Yoon , Mohit Bansal , Huaxiu Yao