English
Related papers

Related papers: Social-Transmotion: Promptable Human Trajectory Pr…

200 papers

Anticipating human actions in front of autonomous vehicles is a challenging task. Several papers have recently proposed model architectures to address this problem by combining multiple input features to predict pedestrian crossing actions.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Lina Achaji , Julien Moreau , François Aioun , François Charpillet

This paper reports on a data-driven, interaction-aware motion prediction approach for pedestrians in environments cluttered with static obstacles. When navigating in such workspaces shared with humans, robots need accurate motion…

Robotics · Computer Science 2018-02-27 Mark Pfeiffer , Giuseppe Paolo , Hannes Sommer , Juan Nieto , Roland Siegwart , Cesar Cadena

Understanding the multiple socially-acceptable future behaviors is an essential task for many vision applications. In this paper, we propose a tree-based method, termed as Social Interpretable Tree (SIT), to address this multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Liushuai Shi , Le Wang , Chengjiang Long , Sanping Zhou , Fang Zheng , Nanning Zheng , Gang Hua

For robots to be a part of our daily life, they need to be able to navigate among crowds not only safely but also in a socially compliant fashion. This is a challenging problem because humans tend to navigate by implicitly cooperating with…

Robotics · Computer Science 2017-05-18 Anirudh Vemula , Katharina Muelling , Jean Oh

Understanding social signals in multi-party conversations is important for human-robot interaction and artificial social intelligence. Social signals include body pose, head pose, speech, and context-specific activities like acquiring and…

Machine Learning · Computer Science 2025-02-04 Yiming Tang , Abrar Anwar , Jesse Thomason

Inferring relational behavior between road users as well as road users and their surrounding physical space is an important step toward effective modeling and prediction of navigation strategies adopted by participants in road scenes. To…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Chiho Choi , Behzad Dariush

Turn-taking is richly multimodal. Predictive turn-taking models (PTTMs) facilitate naturalistic human-robot interaction, yet most rely solely on speech. We introduce MM-VAP, a multimodal PTTM which combines speech with visual cues including…

Computation and Language · Computer Science 2025-10-27 Sam O'Connor Russell , Naomi Harte

Pedestrian trajectory prediction in urban scenarios is essential for automated driving. This task is challenging because the behavior of pedestrians is influenced by both their own history paths and the interactions with others. Previous…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Chi Zhang , Christian Berger , Marco Dozza

The trajectory prediction is significant for the decision-making of autonomous driving vehicles. In this paper, we propose a model to predict the trajectories of target agents around an autonomous vehicle. The main idea of our method is…

Machine Learning · Computer Science 2020-07-08 Tao Yang , Zhixiong Nan , He Zhang , Shitao Chen , Nanning Zheng

Human motion prediction aims at generating future frames of human motion based on an observed sequence of skeletons. Recent methods employ the latest hidden states of a recurrent neural network (RNN) to encode the historical skeletons,…

Computer Vision and Pattern Recognition · Computer Science 2018-05-08 Yongyi Tang , Lin Ma , Wei Liu , Weishi Zheng

Automated co-located human-human interaction analysis has been addressed by the use of nonverbal communication as measurable evidence of social and psychological phenomena. We survey the computing studies (since 2010) detecting phenomena…

Human-Computer Interaction · Computer Science 2023-10-05 Cigdem Beyan , Alessandro Vinciarelli , Alessio Del Bue

Pedestrian trajectory prediction plays an important role in autonomous driving systems and robotics. Recent work utilizing prominent deep learning models for pedestrian motion prediction makes limited a priori assumptions about human…

Robotics · Computer Science 2024-03-12 Honghui Wang , Weiming Zhi , Gustavo Batista , Rohitash Chandra

Predicting human mobility is crucial for urban planning, traffic control, and emergency response. Mobility behaviors can be categorized into individual and collective, and these behaviors are recorded by diverse mobility data, such as…

Machine Learning · Computer Science 2024-12-23 Qingyue Long , Yuan Yuan , Yong Li

We introduce a unified approach to forecast the dynamics of human keypoints along with the motion trajectory based on a short sequence of input poses. While many studies address either full-body pose prediction or motion trajectory…

Robotics · Computer Science 2025-05-22 Nisarga Nilavadi , Andrey Rudenko , Timm Linder

In applications such as autonomous driving, it is important to understand, infer, and anticipate the intention and future behavior of pedestrians. This ability allows vehicles to avoid collisions and improve ride safety and quality. This…

Robotics · Computer Science 2019-09-16 Xiaoxiao Du , Ram Vasudevan , Matthew Johnson-Roberson

Pedestrian trajectory prediction is the key technology in many applications for providing insights into human behavior and anticipating human future motions. Most existing empirical models are explicitly formulated by observed human…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Wei Xiang , Haoteng Yin , He Wang , Xiaogang Jin

Human motion prediction is still an open problem extremely important for autonomous driving and safety applications. Due to the complex spatiotemporal relation of motion sequences, this remains a challenging problem not only for movement…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Edgar Medina , Leyong Loh , Namrata Gurung , Kyung Hun Oh , Niels Heller

As humans we possess an intuitive ability for navigation which we master through years of practice; however existing approaches to model this trait for diverse tasks including monitoring pedestrian flow and detecting abnormal events have…

Computer Vision and Pattern Recognition · Computer Science 2017-02-21 Tharindu Fernando , Simon Denman , Sridha Sridharan , Clinton Fookes

Close human-robot cooperation is a key enabler for new developments in advanced manufacturing and assistive applications. Close cooperation require robots that can predict human actions and intent, and understand human non-verbal cues.…

Human-Computer Interaction · Computer Science 2019-02-19 Paul Schydlo , Mirko Rakovic , Lorenzo Jamone , José Santos-Victor

Effective modeling of human interactions is of utmost importance when forecasting behaviors such as future trajectories. Each individual, with its motion, influences surrounding agents since everyone obeys to social non-written rules such…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Francesco Marchetti , Federico Becattini , Lorenzo Seidenari , Alberto Del Bimbo