中文
相关论文

相关论文: Multi-modal Motion Prediction with Transformer-bas…

200 篇论文

This technical report presents an effective method for motion prediction in autonomous driving. We develop a Transformer-based method for input encoding and trajectory prediction. Besides, we propose the Temporal Flow Header to enhance the…

计算机视觉与模式识别 · 计算机科学 2022-07-04 Yuting Wang , Hangning Zhou , Zhigang Zhang , Chen Feng , Huadong Lin , Chaofei Gao , Yizhi Tang , Zhenting Zhao , Shiyu Zhang , Jie Guo , Xuefeng Wang , Ziyao Xu , Chi Zhang

Motion forecasting represents a critical challenge in autonomous driving systems, requiring accurate prediction of surrounding agents' future trajectories. While existing approaches predict future motion states with the extracted scene…

计算机视觉与模式识别 · 计算机科学 2025-05-22 Xiaodong Mei , Sheng Wang , Jie Cheng , Yingbing Chen , Dan Xu

In this work, we propose a learning based neural model that provides both the longitudinal and lateral control commands to simultaneously navigate multiple vehicles. The goal is to ensure that each vehicle reaches a desired target state…

机器人学 · 计算机科学 2024-03-22 Yining Ma , Qadeer Khan , Daniel Cremers

We propose an attention-based approach for multimodal image patch matching using a Transformer encoder attending to the feature maps of a multiscale Siamese CNN. Our encoder is shown to efficiently aggregate multiscale image embeddings…

计算机视觉与模式识别 · 计算机科学 2023-09-26 Aviad Moreshet , Yosi Keller

Nowadays, our mobility systems are evolving into the era of intelligent vehicles that aim to improve road safety. Due to their vulnerability, pedestrians are the users who will benefit the most from these developments. However, predicting…

计算机视觉与模式识别 · 计算机科学 2022-03-18 Lina Achaji , Thierno Barry , Thibault Fouqueray , Julien Moreau , Francois Aioun , Francois Charpillet

The state of the art in learning meaningful semantic representations of words is the Transformer model and its attention mechanisms. Simply put, the attention mechanisms learn to attend to specific parts of the input dispensing recurrence…

Latest development of neural models has connected the encoder and decoder through a self-attention mechanism. In particular, Transformer, which is solely based on self-attention, has led to breakthroughs in Natural Language Processing (NLP)…

计算与语言 · 计算机科学 2019-11-07 Xindian Ma , Peng Zhang , Shuai Zhang , Nan Duan , Yuexian Hou , Dawei Song , Ming Zhou

This paper presents online-capable deep learning model for probabilistic vehicle trajectory prediction. We propose a simple encoder-decoder architecture based on multi-head attention. The proposed model generates the distribution of the…

计算机视觉与模式识别 · 计算机科学 2020-07-07 Hayoung Kim , Dongchan Kim , Gihoon Kim , Jeongmin Cho , Kunsoo Huh

Autonomous navigation in crowded, complex urban environments requires interacting with other agents on the road. A common solution to this problem is to use a prediction model to guess the likely future actions of other agents. While this…

机器学习 · 计算机科学 2021-03-24 Xiaoyi Chen , Pratik Chaudhari

A multi-modal framework to generate user intention distributions when operating a mobile vehicle is proposed in this work. The model learns from past observed trajectories and leverages traversability information derived from the visual…

机器人学 · 计算机科学 2022-03-17 Kavindie Katuwandeniya , Stefan H. Kiss , Lei Shi , Jaime Valls Miro

Vehicular platooning promises transformative improvements in transportation efficiency and safety through the coordination of multi-vehicle formations enabled by Vehicle-to-Everything (V2X) communication. However, the distributed nature of…

密码学与安全 · 计算机科学 2025-12-24 Konstantinos Kalogiannis , Ahmed Mohamed Hussain , Hexu Li , Panos Papadimitratos

Human pose forecasting garners attention for its diverse applications. However, challenges in modeling the multi-modal nature of human motion and intricate interactions among agents persist, particularly with longer timescales and more…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Jaewoo Jeong , Daehee Park , Kuk-Jin Yoon

Simultaneous trajectory prediction for multiple heterogeneous traffic participants is essential for the safe and efficient operation of connected automated vehicles under complex driving situations in the real world. The multi-agent…

机器人学 · 计算机科学 2021-06-15 Xiaoyu Mo , Yang Xing , Chen Lv

The Transformer is a sequence model that forgoes traditional recurrent architectures in favor of a fully attention-based approach. Besides improving performance, an advantage of using attention is that it can also help to interpret a model…

人机交互 · 计算机科学 2019-06-14 Jesse Vig

Recent advancements in attention mechanisms have replaced recurrent neural networks and its variants for machine translation tasks. Transformer using attention mechanism solely achieved state-of-the-art results in sequence modeling. Neural…

计算与语言 · 计算机科学 2020-04-02 Prakhar Thapak , Prodip Hore

Trajectory prediction in urban mixed-traffic zones (a.k.a. shared spaces) is critical for many intelligent transportation systems, such as intent detection for autonomous driving. However, there are many challenges to predict the…

计算机视觉与模式识别 · 计算机科学 2020-06-24 Hao Cheng , Wentong Liao , Michael Ying Yang , Monika Sester , Bodo Rosenhahn

Predicting vehicle trajectories plays an important role in autonomous driving and ITS applications. Although multiple deep learning algorithms are devised to predict vehicle trajectories, their reliant on specific graph structure (e.g.,…

机器人学 · 计算机科学 2026-04-09 Diyi Liu , Zihan Niu , Tu Xu , Lishan Sun

Predicting the future behavior of moving agents is essential for real world applications. It is challenging as the intent of the agent and the corresponding behavior is unknown and intrinsically multimodal. Our key insight is that for…

计算机视觉与模式识别 · 计算机科学 2020-08-24 Hang Zhao , Jiyang Gao , Tian Lan , Chen Sun , Benjamin Sapp , Balakrishnan Varadarajan , Yue Shen , Yi Shen , Yuning Chai , Cordelia Schmid , Congcong Li , Dragomir Anguelov

Autonomous vehicles need to accomplish their tasks while interacting with human drivers in traffic. It is thus crucial to equip autonomous vehicles with artificial reasoning to better comprehend the intentions of the surrounding traffic,…

人工智能 · 计算机科学 2023-11-02 Xiao Li , Kaiwen Liu , H. Eric Tseng , Anouck Girard , Ilya Kolmanovsky

Scalable multi-agent driving simulation requires behavior models that are both realistic and computationally efficient. We address this by optimizing the behavior model that controls individual traffic participants. To improve efficiency,…

机器人学 · 计算机科学 2026-04-15 Fabian Konstantinidis , Moritz Sackmann , Ulrich Hofmann , Christoph Stiller