English
Related papers

Related papers: Generative Modeling of Multimodal Multi-Human Beha…

200 papers

Humans have internal models of robots (like their physical capabilities), the world (like what will happen next), and their tasks (like a preferred goal). However, human internal models are not always perfect: for example, it is easy to…

Robotics · Computer Science 2023-01-04 Ran Tian , Masayoshi Tomizuka , Anca Dragan , Andrea Bajcsy

Given a probability distribution $\mu$ in $\mathbb{R}^d$ represented by data, we study in this paper the generative modeling of the corresponding conditional probability distributions on the level-sets of a collective variable…

Machine Learning · Statistics 2026-03-30 Fatima-Zahrae Akhyar , Wei Zhang , Gabriel Stoltz , Christof Schütte

Motion forecasts of road users (i.e., agents) vary in complexity depending on the number of agents, scene constraints, and interactions. In particular, the output space of joint trajectory distributions grows exponentially with the number…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Royden Wagner , Omer Sahin Tas , Felix Hauser , Marlon Steiner , Dominik Strutz , Abhishek Vivekanandan , Jaime Villa , Yinzhe Shen , Carlos Fernandez , Christoph Stiller

Assistance robots have gained widespread attention in various industries such as logistics and human assistance. The tasks of guiding or following a human in a crowded environment such as airports or train stations to carry weight or goods…

Robotics · Computer Science 2022-06-14 Linh Kästner , Bassel Fatloun , Zhengcheng Shen , Daniel Gawrisch , Jens Lambrecht

The strategic behaviour of pedestrians is largely determined by how they perceive and react to neighbouring people. This issue is addressed in this paper by a model which combines, in a time and space-dependent way, discrete and continuous…

Physics and Society · Physics 2016-06-23 Annachiara Colombi , Marco Scianna , Andrea Tosin

This paper presents a novel approach for learning self-awareness models for autonomous vehicles. The proposed technique is based on the availability of synchronized multi-sensor dynamic data related to different maneuvering tasks performed…

Computer Vision and Pattern Recognition · Computer Science 2018-06-08 Mahdyar Ravanbakhsh , Mohamad Baydoun , Damian Campo , Pablo Marin , David Martin , Lucio Marcenaro , Carlo S. Regazzoni

Multi-agent systems exhibit complex behaviors that emanate from the interactions of multiple agents in a shared environment. In this work, we are interested in controlling one agent in a multi-agent system and successfully learn to interact…

Machine Learning · Computer Science 2020-01-30 Georgios Papoudakis , Stefano V. Albrecht

The ability to predict multiple possible future positions of the ego-vehicle given the surrounding context while also estimating their probabilities is key to safe autonomous driving. Most of the current state-of-the-art Deep Learning…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Thomas Kurbiel , Akash Sachdeva , Kun Zhao , Markus Buehren

This work presents a non-parametric spatio-temporal model for mapping human activity by mobile autonomous robots in a long-term context. Based on Variational Gaussian Process Regression, the model incorporates prior information of spatial…

Robotics · Computer Science 2022-07-12 Marvin Stuede , Moritz Schappler

Predicting future trajectories of surrounding obstacles is a crucial task for autonomous driving cars to achieve a high degree of road safety. There are several challenges in trajectory prediction in real-world traffic scenarios, including…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Bo Dong , Hao Liu , Yu Bai , Jinbiao Lin , Zhuoran Xu , Xinyu Xu , Qi Kong

This paper introduces a Multi-modal Diffusion model for Motion Prediction (MDMP) that integrates and synchronizes skeletal data and textual descriptions of actions to generate refined long-term motion predictions with quantifiable…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Leo Bringer , Joey Wilson , Kira Barton , Maani Ghaffari

Learning interpretable representations of data generative latent factors is an important topic for the development of artificial intelligence. With the rise of the large multimodal model, it can align images with text to generate answers.…

Machine Learning · Computer Science 2024-04-19 Mengdan Zhu , Zhenke Liu , Bo Pan , Abhinav Angirekula , Liang Zhao

Effective modeling of human interactions is of utmost importance when forecasting behaviors such as future trajectories. Each individual, with its motion, influences surrounding agents since everyone obeys to social non-written rules such…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Francesco Marchetti , Federico Becattini , Lorenzo Seidenari , Alberto Del Bimbo

We introduce a method for learning the dynamics of complex nonlinear systems based on deep generative models over temporal segments of states and actions. Unlike dynamics models that operate over individual discrete timesteps, we learn the…

Machine Learning · Computer Science 2017-07-14 Nikhil Mishra , Pieter Abbeel , Igor Mordatch

Understanding and predicting the intention of pedestrians is essential to enable autonomous vehicles and mobile robots to navigate crowds. This problem becomes increasingly complex when we consider the uncertainty and multimodality of…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Stuart Eiffert , Kunming Li , Mao Shan , Stewart Worrall , Salah Sukkarieh , Eduardo Nebot

We propose a probabilistic framework for developing computational models of biological neural systems. In this framework, physiological recordings are viewed as discrete-time partial observations of an underlying continuous-time stochastic…

Neurons and Cognition · Quantitative Biology 2026-02-10 Ahmed ElGazzar , Marcel van Gerven

In industrial environments, predicting human actions is essential for ensuring safe and effective collaboration between humans and robots. This paper introduces a perception framework that enables mobile robots to understand and share…

Robotics · Computer Science 2025-01-09 Ali Imran , Giovanni Beltrame , David St-Onge

A large body of work in behavioral fields attempts to develop models that describe the way people, as opposed to rational agents, make decisions. A recent Choice Prediction Competition (2015) challenged researchers to suggest a model that…

Machine Learning · Computer Science 2016-12-01 Gali Noti , Effi Levi , Yoav Kolumbus , Amit Daniely

This paper considers neural representation through the lens of active inference, a normative framework for understanding brain function. It delves into how living organisms employ generative models to minimize the discrepancy between…

Neurons and Cognition · Quantitative Biology 2023-10-24 Giovanni Pezzulo , Leo D'Amato , Francesco Mannella , Matteo Priorelli , Toon Van de Maele , Ivilin Peev Stoianov , Karl Friston

Human trajectory data is crucial in urban planning, traffic engineering, and public health. However, directly using real-world trajectory data often faces challenges such as privacy concerns, data acquisition costs, and data quality. A…

Machine Learning · Computer Science 2025-11-05 Qingyue Long , Can Rong , Tong Li , Yong Li