English
Related papers

Related papers: Multi-modal Motion Prediction with Transformer-bas…

200 papers

This study investigates the task of dwell time prediction and proposes a Transformer framework based on interaction behavior modeling. The method first represents user interaction sequences on the interface by integrating dwell duration,…

Human-Computer Interaction · Computer Science 2025-12-22 Rui Liu , Runsheng Zhang , Shixiao Wang

Most approaches for semantic segmentation use only information from color cameras to parse the scenes, yet recent advancements show that using depth data allows to further improve performances. In this work, we focus on transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Francesco Barbato , Giulia Rizzoli , Pietro Zanuttigh

Multi-agent systems exhibit complex behaviors that emanate from the interactions of multiple agents in a shared environment. In this work, we are interested in controlling one agent in a multi-agent system and successfully learn to interact…

Machine Learning · Computer Science 2020-01-30 Georgios Papoudakis , Stefano V. Albrecht

This paper proposes a learning model, based on rank-fusion graphs, for general applicability in multimodal prediction tasks, such as multimodal regression and image classification. Rank-fusion graphs encode information from multiple…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Icaro Cavalcante Dourado , Salvatore Tabbone , Ricardo da Silva Torres

Autonomous vehicles are expected to drive in complex scenarios with several independent non cooperating agents. Path planning for safely navigating in such environments can not just rely on perceiving present location and motion of other…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Francesco Marchetti , Federico Becattini , Lorenzo Seidenari , Alberto Del Bimbo

Planning and prediction are two important modules of autonomous driving and have experienced tremendous advancement recently. Nevertheless, most existing methods regard planning and prediction as independent and ignore the correlation…

Robotics · Computer Science 2023-09-08 Jiawei Fu , Yanqing Shen , Zhiqiang Jian , Shitao Chen , Jingmin Xin , Nanning Zheng

Transformers have enabled breakthroughs in NLP and computer vision, and have recently began to show promising performance in trajectory prediction for Autonomous Vehicle (AV). How to efficiently model the interactive relationships between…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Xiaocheng Tang , Soheil Sadeghi Eshkevari , Haoyu Chen , Weidan Wu , Wei Qian , Xiaoming Wang

Accurate motion forecasting for traffic agents is crucial for ensuring the safety and efficiency of autonomous driving systems in dynamically changing environments. Mainstream methods adopt a one-query-one-trajectory paradigm, where each…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Bozhou Zhang , Nan Song , Li Zhang

Long-term traffic prediction is highly challenging due to the complexity of traffic systems and the constantly changing nature of many impacting factors. In this paper, we focus on the spatio-temporal factors, and propose a graph…

Signal Processing · Electrical Eng. & Systems 2019-11-27 Chuanpan Zheng , Xiaoliang Fan , Cheng Wang , Jianzhong Qi

Behavior prediction in dynamic, multi-agent systems is an important problem in the context of self-driving cars, due to the complex representations and interactions of road components, including moving agents (e.g. pedestrians and vehicles)…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Jiyang Gao , Chen Sun , Hang Zhao , Yi Shen , Dragomir Anguelov , Congcong Li , Cordelia Schmid

The ability to predict the future movements of other vehicles is a subconscious and effortless skill for humans and key to safe autonomous driving. Therefore, trajectory prediction for autonomous cars has gained a lot of attention in recent…

Robotics · Computer Science 2021-09-16 Benedikt Mersch , Thomas Höllen , Kun Zhao , Cyrill Stachniss , Ribana Roscher

Motion prediction plays an important role in autonomous driving. This study presents LMFormer, a lane-aware transformer network for trajectory prediction tasks. In contrast to previous studies, our work provides a simple mechanism to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Harsh Yadav , Maximilian Schaefer , Kun Zhao , Tobias Meisen

Prediction of human motions is key for safe navigation of autonomous robots among humans. In cluttered environments, several motion hypotheses may exist for a pedestrian, due to its interactions with the environment and other pedestrians.…

Robotics · Computer Science 2020-11-17 Bruno Brito , Hai Zhu , Wei Pan , Javier Alonso-Mora

Vision Transformers are very popular nowadays due to their state-of-the-art performance in several computer vision tasks, such as image classification and action recognition. Although their performance has been greatly enhanced through…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Dimitrios Konstantinidis , Ilias Papastratis , Kosmas Dimitropoulos , Petros Daras

Dynamical complex systems composed of interactive heterogeneous agents are prevalent in the world, including urban traffic systems and social networks. Modeling the interactions among agents is the key to understanding and predicting the…

Multiagent Systems · Computer Science 2024-10-30 Siyuan Chen , Jiahai Wang

Human intention prediction provides an augmented solution for the design of assistants and collaboration between the human driver and intelligent vehicles. In this study, a multi-task sequential learning framework is developed to predict…

Human-Computer Interaction · Computer Science 2022-07-04 Yang Xing , Wenbo Li , Xiaoyu Mo , Chen Lv

The exploration of high-speed movement by robots or road traffic agents is crucial for autonomous driving and navigation. Trajectory prediction at high speeds requires considering historical features and interactions with surrounding…

Robotics · Computer Science 2024-05-14 Yao Liu , Ruoyu Wang , Yuanjiang Cao , Quan Z. Sheng , Lina Yao

Human behavior in interactive settings is shaped not only by individual objectives but also by shared constraints with others, such as safety. Understanding how people allocate responsibility, i.e., how much one deviates from their desired…

Multiagent Systems · Computer Science 2026-04-16 Isaac Remy , Caleb Chang , Karen Leung

Context plays a significant role in the generation of motion for dynamic agents in interactive environments. This work proposes a modular method that utilises a learned model of the environment for motion prediction. This modularity…

Machine Learning · Computer Science 2021-01-05 Todor Davchev , Michael Burke , Subramanian Ramamoorthy

Neuromorphic visual sensors are artificial retinas that output sequences of asynchronous events when brightness changes occur in the scene. These sensors offer many advantages including very high temporal resolution, no motion blur and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Daniel Deniz , Cornelia Fermuller , Eduardo Ros , Manuel Rodriguez-Alvarez , Francisco Barranco