English
Related papers

Related papers: Leveraging Language Foundation Models for Human Mo…

200 papers

Pedestrian intention and trajectory prediction are critical for the safe deployment of autonomous driving systems, directly influencing navigation decisions in complex traffic environments. Recent advances in large vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Naman Mishra , Shankar Gangisetty , C. V. Jawahar

Next Point-of-Interest (POI) recommendation is a fundamental task in location-based services. While recent advances leverage Large Language Model (LLM) for sequential modeling, existing LLM-based approaches face two key limitations: (i)…

Information Retrieval · Computer Science 2025-12-09 Dongsheng Wang , Shen Gao , Chengrui Huang , Yuxi Huang , Ruixiang Feng , Shuo Shang

Current Conversational AI systems employ different machine learning pipelines, as well as external knowledge sources and business logic to predict the next action. Maintaining various components in dialogue managers' pipeline adds…

Computation and Language · Computer Science 2024-04-15 Amin Hosseiny Marani , Ulie Schnaithmann , Youngseo Son , Akil Iyer , Manas Paldhe , Arushi Raghuvanshi

Trajectory prediction serves as a critical functionality in autonomous driving, enabling the anticipation of future motion paths for traffic participants such as vehicles and pedestrians, which is essential for driving safety. Although…

Robotics · Computer Science 2025-09-16 Wei Dai , Shengen Wu , Wei Wu , Zhenhao Wang , Sisuo Lyu , Haicheng Liao , Limin Yu , Weiping Ding , Runwei Guan , Yutao Yue

The rapid growth of location acquisition technologies makes Point-of-Interest(POI) recommendation possible due to redundant user check-in records. In this paper, we focus on next POI recommendation in which next POI is based on previous…

Information Retrieval · Computer Science 2024-04-11 Yiping Sun

The prediction of traffic flow is a challenging yet crucial problem in spatial-temporal analysis, which has recently gained increasing interest. In addition to spatial-temporal correlations, the functionality of urban areas also plays a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Kuo Wang , Lingbo Liu , Yang Liu , Guanbin Li , Fan Zhou , Liang Lin

Time series forecasting traditionally relies on unimodal numerical inputs, which often struggle to capture high-level semantic patterns due to their dense and unstructured nature. While recent approaches have explored representing time…

Machine Learning · Computer Science 2025-07-02 Sixun Dong , Wei Fan , Teresa Wu , Yanjie Fu

Next Point-of-Interest (POI) recommendation plays a crucial role in urban mobility applications. Recently, POI recommendation models based on Graph Neural Networks (GNN) have been extensively studied and achieved, however, the effective…

Individual-level human mobility prediction has emerged as a significant topic of research with applications in infectious disease monitoring, child, and elderly care. Existing studies predominantly focus on the microscopic aspects of human…

Machine Learning · Computer Science 2025-08-20 Yueyang Liu , Lance Kennedy , Ruochen Kong , Joon-Seok Kim , Andreas Züfle

In social robotics, a pivotal focus is enabling robots to engage with humans in a more natural and seamless manner. The emergence of advanced large language models (LLMs) such as Generative Pre-trained Transformers (GPTs) and autoregressive…

Robotics · Computer Science 2024-09-30 Alkesh K. Srivastava , Philip Dames

In this paper, we develop an embodied AI system for human-in-the-loop navigation with a wheeled mobile robot. We propose a direct yet effective method of monitoring the robot's current plan to detect changes in the environment that impact…

Robotics · Computer Science 2024-10-01 Cody Simons , Zhichao Liu , Brandon Marcus , Amit K. Roy-Chowdhury , Konstantinos Karydis

Predicting the future is of great interest across many aspects of human activity. Businesses are interested in future trends, traders are interested in future stock prices, and companies are highly interested in future technological…

Computation and Language · Computer Science 2024-04-17 Changmao Li , Jeffrey Flanigan

This paper provides a comprehensive survey of recent advancements in leveraging machine learning techniques, particularly Transformer models, for predicting human mobility patterns during epidemics. Understanding how people move during…

Crowd and flow predictions have been extensively studied in mobility data science. Traditional forecasting methods have relied on statistical models such as ARIMA, later supplemented by deep learning approaches like ST-ResNet. More…

Machine Learning · Computer Science 2025-04-08 Anita Graser

Conversational modeling is an important task in natural language understanding and machine intelligence. Although previous approaches exist, they are often restricted to specific domains (e.g., booking an airline ticket) and require…

Computation and Language · Computer Science 2015-07-23 Oriol Vinyals , Quoc Le

Procedure planning requires a model to predict a sequence of actions that transform a start visual observation into a goal in instructional videos. While most existing methods rely primarily on visual observations as input, they often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Lei Shi , Victor Aregbede , Andreas Persson , Martin Längkvist , Amy Loutfi , Stephanie Lowry

The development of many vision models mainly focuses on improving their performance using metrics such as accuracy, IoU, and mAP, with less attention to explainability due to the complexity of applying xAI methods to provide a meaningful…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Phu-Vinh Nguyen , Tan-Hanh Pham , Chris Ngo , Truong Son Hy

Human mobility prediction is vital for urban services, but often fails to account for abrupt changes from external events. Existing spatiotemporal models struggle to leverage textual descriptions detailing these events. We propose SeMob, an…

Computation and Language · Computer Science 2025-10-03 Runfei Chen , Shuyang Jiang , Wei Huang

Humans use spatial language to naturally describe object locations and their relations. Interpreting spatial language not only adds a perceptual modality for robots, but also reduces the barrier of interfacing with humans. Previous work…

Robotics · Computer Science 2021-08-03 Kaiyu Zheng , Deniz Bayazit , Rebecca Mathew , Ellie Pavlick , Stefanie Tellex

The speaker-follower models have proven to be effective in vision-and-language navigation, where a speaker model is used to synthesize new instructions to augment the training data for a follower navigation model. However, in many of the…

Computation and Language · Computer Science 2022-06-10 Zi-Yi Dou , Nanyun Peng