English
Related papers

Related papers: TR-LLM: Integrating Trajectory Data for Scene-Awar…

200 papers

In autonomous exploration tasks, robots are required to explore and map unknown environments while efficiently planning in dynamic and uncertain conditions. Given the significant variability of environments, human operators often have…

Robotics · Computer Science 2025-03-11 Shuhao Liao , Xuxin Lv , Yuhong Cao , Jeric Lew , Wenjun Wu , Guillaume Sartoretti

Traffic forecasting is pivotal for intelligent transportation systems, where accurate and interpretable predictions can significantly enhance operational efficiency and safety. A key challenge stems from the heterogeneity of traffic…

Machine Learning · Computer Science 2025-11-17 Seyed Mohamad Moghadas , Bruno Cornelis , Alexandre Alahi , Adrian Munteanu

Traffic prediction plays a central role in intelligent transportation systems (ITS) by supporting real-time decision-making, congestion management, and long-term planning. However, many existing approaches face practical limitations. Most…

Machine Learning · Computer Science 2026-04-21 Seerat Kaur , Sukhjit Singh Sehra , Dariush Ebrahimi

Human mobility prediction is essential for applications like urban planning and transportation management, yet it remains challenging due to the complex, often implicit, intentions behind human behavior. Existing models predominantly focus…

Computation and Language · Computer Science 2024-08-26 Songwei Li , Jie Feng , Jiawei Chi , Xinyuan Hu , Xiaomeng Zhao , Fengli Xu

This study introduces intelligent frameworks that use Large Language Models (LLMs) to improve task scheduling for construction robots. The LLM is fed with key data about the desired task, such as agent action abilities, and the desired end…

Robotics · Computer Science 2026-05-18 Swayamjit Saha , Subhabrata Das , Haonan Duan , Xiao-Yang Liu

Multimodal recommender systems (MRS) integrate heterogeneous user and item data, such as text, images, and structured information, to enhance recommendation performance. The emergence of large language models (LLMs) introduces new…

Information Retrieval · Computer Science 2025-05-16 Alejo Lopez-Avila , Jinhua Du

We introduce Language Feedback Models (LFMs) that identify desirable behaviour - actions that help achieve tasks specified in the instruction - for imitation learning in instruction following. To train LFMs, we obtain feedback from Large…

Machine Learning · Computer Science 2024-10-11 Victor Zhong , Dipendra Misra , Xingdi Yuan , Marc-Alexandre Côté

Recent advancements in Generative AI, particularly in Large Language Models (LLMs) and Large Vision-Language Models (LVLMs), offer new possibilities for integrating cognitive planning into robotic systems. In this work, we present a novel…

Robotics · Computer Science 2024-11-06 Arjun P S , Andrew Melnik , Gora Chand Nandi

Large Language Models (LLMs) pre-trained on internet-scale datasets have shown impressive capabilities in code understanding, synthesis, and general purpose question-and-answering. Key to their performance is the substantial prior knowledge…

Robotics · Computer Science 2023-11-03 Andrea Tagliabue , Kota Kondo , Tong Zhao , Mason Peterson , Claudius T. Tewari , Jonathan P. How

Large Language models (LLMs) have shown remarkable success in assisting robot learning tasks, i.e., complex household planning. However, the performance of pretrained LLMs heavily relies on domain-specific templated text data, which may be…

Robotics · Computer Science 2023-06-12 Jielin Qiu , Mengdi Xu , William Han , Seungwhan Moon , Ding Zhao

Recently, large language models (LLMs) have demonstrated powerful capabilities in performing various tasks and thus are applied by recent studies to time series forecasting (TSF) tasks, which predict future values with the given historical…

Computation and Language · Computer Science 2025-07-15 Chen Su , Yuanhe Tian , Qinyu Liu , Jun Zhang , Yan Song

Large language models (LLMs) are increasingly used to model human social behavior, with recent research exploring their ability to simulate social dynamics. Here, we test whether LLMs mirror human behavior in social dilemmas, where…

Social and Information Networks · Computer Science 2024-11-18 Jin Han , Balaraju Battu , Ivan Romić , Talal Rahwan , Petter Holme

This paper introduces Scene-LLM, a 3D-visual-language model that enhances embodied agents' abilities in interactive 3D indoor environments by integrating the reasoning strengths of Large Language Models (LLMs). Scene-LLM adopts a hybrid 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Rao Fu , Jingyu Liu , Xilun Chen , Yixin Nie , Wenhan Xiong

Driving in safety-critical scenarios requires quick, context-aware decision-making grounded in both situational understanding and experiential reasoning. Large Language Models (LLMs), with their powerful general-purpose reasoning…

Artificial Intelligence · Computer Science 2025-06-26 Wenbin Gan , Minh-Son Dao , Koji Zettsu

Pedestrian trajectory prediction is essential for collision avoidance in autonomous driving and robot navigation. However, predicting a pedestrian's trajectory in crowded environments is non-trivial as it is influenced by other pedestrians'…

Computer Vision and Pattern Recognition · Computer Science 2019-02-15 Sirin Haddad , Meiqing Wu , He Wei , Siew Kei Lam

Recently, Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) have shown promise in instruction following and 2D image understanding. While these models are powerful, they have not yet been developed to comprehend the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Senqiao Yang , Jiaming Liu , Ray Zhang , Mingjie Pan , Zoey Guo , Xiaoqi Li , Zehui Chen , Peng Gao , Yandong Guo , Shanghang Zhang

Navigating robots through unstructured terrains is challenging, primarily due to the dynamic environmental changes. While humans adeptly navigate such terrains by using context from their observations, creating a similar context-aware…

Traffic flow forecasting aims to predict future traffic flows based on the historical traffic conditions and the road network. It is an important problem in intelligent transportation systems, with a plethora of methods been proposed.…

Machine Learning · Computer Science 2025-08-04 Yusheng Zhao , Xiao Luo , Haomin Wen , Zhiping Xiao , Wei Ju , Ming Zhang

TalkWithMachines aims to enhance human-robot interaction by contributing to interpretable industrial robotic systems, especially for safety-critical applications. The presented paper investigates recent advancements in Large Language Models…

Robotics · Computer Science 2024-12-23 Ammar N. Abbas , Csaba Beleznai

Large language models (LLMs) have the potential to aid and improve human decision-making in classification tasks, not only by providing fairly accurate predictions, but also in their ability to generate cogent narrative explanations of…

Human-Computer Interaction · Computer Science 2026-05-25 Laura R. Marusich , Mary Grace Kozuch Dhooghe , Jonathan Z. Bakdash , Murat Kantarcioglu